ktransformers

KTransformers: CPU-GPU heterogeneous inference framework for LLMs

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install ktransformers

Dependencies

  • None

Releases

Version Released Bullseye
Python 3.9
Bookworm
Python 3.11
Trixie
Python 3.13
Files
0.5.3 2026-04-02
0.5.2.post2 2026-03-04
0.5.2.post1 2026-03-04
0.5.2 2026-03-04
0.2.1.post1 2025-02-18      
0.2.1 2025-02-15      
0.1.4 2024-08-30      
0.1.2 2024-08-16      
0.1.1 2024-08-01      
0.1.0 2024-07-29      
0.0.1 2024-07-29      

Issues with this package?

Page last updated 2026-04-02 10:02:50 UTC