pytorch-tokenizers
A package with common tokenizers in Python and C++
v1.2.0BSD 3-Clause License...
AI Health Summary — Claude-generated analysis of download trends, maintenance, and risk signals.
Upgrade to PRONo known vulnerabilities in the latest version
Based on latest version 1.2.0. If you're running an older version, check OSV for your specific version.
Exclude CI/CDPRO
Best Day
14.9K
May 12
Worst Day
4.0K
May 3
Peaks On
Mons
11.6K avg
Quietest
Suns
4.6K avg
Download Trend
Badge
Markdown
[](/packages/pytorch-tokenizers)
HTML
<a href="/packages/pytorch-tokenizers"><img src="/api/badges/pytorch-tokenizers?period=month" alt="PyPI Stats"></a>