An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
No known vulnerabilities in the latest version
[](/packages/auto-gptq)
<a href="/packages/auto-gptq"><img src="/api/badges/auto-gptq?period=month" alt="PyPI Stats"></a>