The open-source LLM API gateway. Stop juggling API keys and provider dashboards. Route requests across 250+ models, track costs in real-time, and switch providers without changing your code.
Scoped keys, spend caps, failover and guardrails live in the gateway, not in your app code. Add SSO and audit logs on Enterprise when the rest of the company joins in.
Sign in with Okta, Entra ID or another SAML 2.0 provider, with SCIM provisioning. Roles per organization and project, and API keys scoped per app.
Detect emails, card numbers, secrets, prompt injection and jailbreak attempts in chat requests. Block, redact or warn, per organization or project.
Set a spend cap on any API key or member and requests stop once it is reached, with optional alerts before a key runs out. Team budgets on Enterprise.
When a provider errors, times out or rate-limits you, the gateway retries up to twice on another provider for that model before it responds. Requests pinned to one provider stay there.
API key, invite, role, budget and compliance policy changes, with who made them and when.
06 / Deployment
Same gateway and dashboard, in our cloud or yours. The core is open source under AGPLv3 and the enterprise code is source-available, so nothing is a black box.
Enterprise Cloud
We run it for you with a 99.9% SLA and dedicated support.
Self-hosted
Docker or Kubernetes with our Helm chart, inside your own network. Enterprise features need a license key.
Provider policy
On Enterprise, route only to providers that meet your rules on headquarters country, data retention and training.
The same routing, billing and analytics run under each one. Start with the API, add the rest when you need it.
One OpenAI-compatible API for 250+ models, with routing, caching, failover and cost analytics on every request. Guardrails on Enterprise.
Cost, latency, errors and cache hits on every request, with spend by model, provider and API key, and by project on Enterprise. Full prompts and responses when you turn on data retention.
Flat-price plans for AI coding. One key for your coding tools, included model usage, and every request tracked by tool in one dashboard.
Chat with GPT, Claude and Gemini, create images, video and speech, and run group chats with several models. Fast models from $9/mo, flagship models from $19/mo.
List your models on LLM Gateway, file your prices, pass review and compete for traffic from teams across the network.
Your app sends one request. We route it to OpenAI, Anthropic, Google, or any of 40+ providers—automatically picking the best path.
Point any OpenAI SDK at LLM Gateway and switch models by changing one string. Start free, pay only when you top up.
import OpenAI from "openai";
const client = new OpenAI({
baseURL: "https://api.llmgateway.io/v1", apiKey: process.env.LLM_GATEWAY_API_KEY,});
const res = await client.chat.completions.create({
model: "anthropic/claude-sonnet-5",
messages: [{ role: "user", content: "Hello" }],
});40+ providers on the network
View all providersLLM Gateway automatically routes requests to healthy providers in real-time. When one goes down, your traffic seamlessly fails over—your users never notice.
Each provider averages ~94% uptime independently. With automatic failover across multiple providers, the probability of simultaneous downtime drops to near zero—giving you effective uptime of 99.9999%.
Everything you need to know about pricing, models, and getting started.
Can't find an answer? Contact us
Unlike OpenRouter, we offer:
When your LLM infrastructure becomes mission-critical, you need dedicated support, compliance controls, and infrastructure that matches your ambitions.
SAML 2.0 single sign-on and SCIM provisioning with role-based access control
Deploy on your infrastructure or let us run it, with a 99.9% SLA on Enterprise Cloud
Custom rate limits and pricing that scales with your usage
White-label gateway and chat app with your own branding
Join thousands of developers processing 100B+ tokens through LLM Gateway. Free tier included, no credit card required.
