Smart Route

Routes to one of the models your organization configured, chosen by a classifier that rates each request.

0 context
Released September 25, 2026
Streaming
Vision
Tools
JSON Output
No ratings yetSign in to rate

Select Provider

All Providers for Smart Route

LLM Gateway routes requests to the best providers that are able to handle your prompt size and parameters.

Context: —
Input
—
/M tokens
Cache Read
—
/M tokens
Output
—
/M tokens
Get Started

Frequently asked questions

What is Smart Route?

Routes to one of the models your organization configured, chosen by a classifier that rates each request. You can access it through LLM Gateway's OpenAI-compatible API with automatic provider routing, fallback, and cost analytics.

How much does Smart Route cost?

Smart Route uses non-token pricing (for example per request, per second, or per page). The provider cards above show the exact current rates for each provider.

Which providers serve Smart Route?

Smart Route is served by LLM Gateway through LLM Gateway. Requests are automatically routed to the best available provider, with fallback when a provider has issues.

Does Smart Route support tool calling and structured outputs?

Smart Route supports tool (function) calling and soft JSON output, but NOT strict JSON output schema (its upstream provider does not enforce it).

When was Smart Route released?

Smart Route was released on September 25, 2026.