All use cases

Use case

LLM gateway for startups

Ship on any model with one API key, and see what every request costs before the bill arrives.

One integration, every model

Use one OpenAI-compatible endpoint and one key. Trying a new model is a change to the model field, not a new SDK, account, and billing setup.

Pay as you go

Buy credits and pay provider token rates plus a 5% fee on credit purchases. Bring your own provider keys and the platform fee is zero.

Stay up when a provider is down

Requests that name a model are retried on another provider that serves it, inside the same API call.

Know your unit economics early

Every request is logged with model, tokens, latency, and cost, so cost per user or per feature is a query, not a guess.

A startup should not be building LLM infrastructure

Early products change models often. A new release is cheaper, a competitor ships a better one, or a provider has an outage during your launch. Each direct integration adds an SDK, an account, a bill, and a rate limit to manage. That work does not make your product better.

An LLM gateway for startups removes it. LLM Gateway gives you one OpenAI-compatible API for every model, with failover and cost tracking included.

Integrate once

Point an OpenAI SDK at the gateway and your existing code works:

1import OpenAI from "openai";2
3const client = new OpenAI({4  baseURL: "https://api.llmgateway.io/v1",5  apiKey: process.env.LLM_GATEWAY_API_KEY,6});7
8const response = await client.chat.completions.create({9  model: "gpt-4o",10  messages: [{ role: "user", content: "Hello" }],11});

Change model to try a different one. The models directory lists what is available and what each provider charges.

Keep the bill predictable

Every request is logged with its model, token counts, latency, and cost. Issue one API key per environment or feature and you can see what each one spends. Keys can carry a usage limit, so a runaway script stops instead of draining your credits.

Survive provider outages

When a provider returns an error, a rate limit, or a timeout, the gateway retries the request on another provider that serves the same model. Your users get an answer. See routing for the rules.

Start hosted, keep your options

Pay-as-you-go credits have a 5% fee on purchases. Bringing your own provider keys costs nothing in platform fees, and the AGPLv3 core can be self-hosted when you need to.

Frequently asked questions

Why would a startup use an LLM gateway instead of calling providers directly?

A gateway gives you one integration for every model, so you can switch or test models without new SDKs, keys, or billing accounts. It also adds failover and per-request cost tracking that you would otherwise build yourself.

What does LLM Gateway cost for a small team?

You pay provider token rates. Pay-as-you-go credits carry a 5% fee on purchases, and requests made with your own provider keys have no platform fee. Self-hosting the open-source core is free.

How long does it take to integrate?

For an application that already uses an OpenAI SDK, change the base URL to https://api.llmgateway.io/v1 and swap the API key. Existing request code keeps working.

Can we self-host later?

Yes. The core gateway is open source under AGPLv3 and can be self-hosted, so starting on the hosted service does not lock you in.

One API for every model

Route across 200+ models with fallback, caching and per-request cost analytics. Start free in minutes.