Pure-Python robots.txt parser with support for modern conventions
[](/packages/Protego)
<a href="/packages/Protego"><img src="/api/badges/Protego?period=month" alt="PyPI Stats"></a>