4-bit GPU kernels that compute directly on packed Mixture-of-Experts weights, for training and inference.
No known vulnerabilities in the latest version
Based on latest version 0.51.0. If you're running an older version, check OSV for your specific version.
[](/packages/grouped-nf4-gemm)
<a href="/packages/grouped-nf4-gemm"><img src="/api/badges/grouped-nf4-gemm?period=month" alt="PyPI Stats"></a>