What happens if the Custom API is down?

When you request a model without a provider prefix, LLM Gateway retries failed requests on other providers that serve the same model, so an outage at Custom does not have to take your app down. Send X-No-Fallback: true with a provider-pinned model when every request must reach Custom.

Custom API

Custom OpenAI-compatible provider with configurable base URL

Get started Try in Lounge

Data & Privacy

Safety identifier:Not forwarded

Available Models

FAQ

Custom API questions

Can't find an answer? Contact us

Create an LLM Gateway API key and point any OpenAI-compatible SDK at https://api.llmgateway.io/v1. You do not need a separate Custom account or SDK.

Custom API

Data & Privacy

Available Models

Custom API questions

How do I use the Custom API?

What happens if the Custom API is down?