Provider-neutral asyncio toolkit for concurrent LLM calls with retries, scoped RPM/TPM admission, bounded streaming, resumable checkpoints, and deadlines.
No known vulnerabilities in the latest version
Based on latest version 0.23.0. If you're running an older version, check OSV for your specific version.
[](/packages/async-batch-llm)
<a href="/packages/async-batch-llm"><img src="/api/badges/async-batch-llm?period=month" alt="PyPI Stats"></a>