Temporary remove unused tokens during training to save ram and speed.
No known vulnerabilities in the latest version
Based on latest version 0.4.2. If you're running an older version, check OSV for your specific version.
[](/packages/transformer-smaller-training-vocab)
<a href="/packages/transformer-smaller-training-vocab"><img src="/api/badges/transformer-smaller-training-vocab?period=month" alt="PyPI Stats"></a>