An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
No known vulnerabilities in the latest version
Based on latest version 0.7.1. If you're running an older version, check OSV for your specific version.
[](/packages/auto-gptq)
<a href="/packages/auto-gptq"><img src="/api/badges/auto-gptq?period=month" alt="PyPI Stats"></a>