LLM Gateway changelog

API, routing, model access, and dashboard updates for LLM Gateway.

Smart Routing

A new `smart` model string: choose which models it may resolve to, and let a classifier rate each request so easy prompts go to a cheap model and hard ones go to a frontier model. Existing `auto` behaviour is unchanged. Available to every organization while in beta; not available on DevPass yet.

Read more about Smart Routing →
Three ascending glowing tiers on a circuit-board chip, surrounded by magnifier, sliders, coin and shield icons, representing the price bands of smart routing on LLM Gateway

Showing 10 of 107 updates

Load more