Provider-neutral asyncio toolkit for concurrent LLM calls with retries, coordinated rate limits, bounded streaming, resumable checkpoints, and deadlines.
No known vulnerabilities in the latest version
Based on latest version 0.20.0. If you're running an older version, check OSV for your specific version.
[](/packages/async-batch-llm)
<a href="/packages/async-batch-llm"><img src="/api/badges/async-batch-llm?period=month" alt="PyPI Stats"></a>