A Fast, spec compliant Python 3.14+ tokenizer that runs on older Pythons.
No known vulnerabilities in the latest version
Based on latest version 0.4.1. If you're running an older version, check OSV for your specific version.
[](/packages/pytokens)
<a href="/packages/pytokens"><img src="/api/badges/pytokens?period=month" alt="PyPI Stats"></a>