octane-sd

End-to-end speculative decoding inference runtime: one command, faster local inference

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install octane-sd

Dependencies

Releases

Version Released Bookworm
Python 3.11
Trixie
Python 3.13
Files
0.1.0 2026-08-06    

Issues with this package?

Page last updated 2026-09-03 14:03:26 UTC