auto-around

Repository of AutoRound: Advanced Weight-Only Quantization Algorithm for LLMs

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install auto-around

Releases

There are no releases of this package yet

Issues with this package?

Page last updated 2024-05-29 16:54:18 UTC