gptq

GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install gptq

Dependencies

  • None

Releases

Version Released Bullseye
Python 3.9
Bookworm
Python 3.11
Trixie
Python 3.13
Files
0.0.3 2023-03-23      
0.0.2 2023-03-13      
0.0.2.dev5 pre-release 2023-03-13      
0.0.2.dev4 pre-release 2023-03-13      
0.0.2.dev3 pre-release 2023-03-13      
0.0.2.dev2 pre-release 2023-03-13      
0.0.2.dev1 pre-release 2023-03-13      
0.0.2.dev0 pre-release 2023-03-13      
0.0.1 2023-03-09      
0.0.1.dev0 pre-release 2023-03-09      

Issues with this package?

Page last updated 2025-09-12 07:01:51 UTC