gptq

GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install gptq

Releases

Version Released Buster
Python 3.7
Bullseye
Python 3.9
Bookworm
Python 3.11
Files
0.0.3 2023-03-23      
0.0.2 2023-03-13      
0.0.2.dev5 pre-release 2023-03-13      
0.0.2.dev4 pre-release 2023-03-13      
0.0.2.dev3 pre-release 2023-03-13      
0.0.2.dev2 pre-release 2023-03-13      
0.0.2.dev1 pre-release 2023-03-13      
0.0.2.dev0 pre-release 2023-03-13      
0.0.1 2023-03-09      
0.0.1.dev0 pre-release 2023-03-09      

Issues with this package?

Page last updated 2024-04-27 18:53:52 UTC