Fine-tune and serve large Mixture-of-Experts models on one GPU, with 4-bit experts in GPU memory, RAM or SSD.
No known vulnerabilities in the latest version
Based on latest version 0.58.1. If you're running an older version, check OSV for your specific version.
[](/packages/experts4bit-qlora)
<a href="/packages/experts4bit-qlora"><img src="/api/badges/experts4bit-qlora?period=month" alt="PyPI Stats"></a>