pytorch-tokenizers

A package with common tokenizers in Python and C++

v1.2.0BSD 3-Clause License...

215.9K

downloads (30d)

No known vulnerabilities in the latest version

Exclude CI/CDPRO

Best Day

13.6K

Mar 18

Worst Day

2.8K

Mar 15

Peaks On

Thus

9.1K avg

Quietest

Suns

3.4K avg

Markdown

[![PyPI Stats](/api/badges/pytorch-tokenizers?period=month)](/packages/pytorch-tokenizers)

HTML

<a href="/packages/pytorch-tokenizers"><img src="/api/badges/pytorch-tokenizers?period=month" alt="PyPI Stats"></a>