Stay inside every upstream quota
Rate Limits
Cap requests and tokens per minute or day on providers, models and individual provider keys, and let routing steer around them.
Your app → LLM Gateway
Capped keys leave rotation until the window slides
01
Requests & tokens
RPM, RPD, TPM and TPD windows.
02
Per provider key
Match each upstream account's quota.
03
Strict, soft or lax
Keep session pins past a cap if you choose.
04
Retry-After
Accurate reset hints on every 429.
Built for
Shared BYOK keys
Spread traffic across several upstream keys
Tier-limited accounts
Strict caps keep traffic inside token quotas
Long sessions
Soft caps keep reasoning on the same key