autoawq

AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference.

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install autoawq

Dependencies

Releases

Version Released Bullseye
Python 3.9
Bookworm
Python 3.11
Trixie
Python 3.13
Files
0.2.9 2025-05-11      
0.2.8 2025-01-20      
0.2.7.post3 2024-12-06
0.2.7.post2 2024-11-18
0.2.7.post1 2024-11-16
0.2.7 2024-11-16
0.2.6 2024-07-23
0.2.5 2024-05-02
0.2.4 2024-03-24
0.2.3 2024-03-02
0.2.2 2024-02-17
0.2.1 2024-02-16
0.2.0 2024-02-15
0.1.8 2023-12-23
0.1.7 2023-11-16
0.1.6 2023-11-04
0.1.5 2023-10-28
0.1.4 2023-10-06
0.1.3 2023-10-05
0.1.2 2023-10-02
0.1.1 2023-10-01
0.1.0 2023-09-21
0.0.2 2023-09-06
0.0.1 2023-09-01

Issues with this package?

Page last updated 2025-09-15 04:40:47 UTC