API, routing, model access, and dashboard updates for LLM Gateway.
Gemini 3.8 Flash lands on Google AI Studio and Vertex AI with a 1M context at $0.75/M input, Meta's Muse Spark 1.3 arrives with a 1M context and a $0.10/M Contributor tier, and Kimi K3, GLM-5.3 Flash, and Qwen3.8 Flash pick up new deployments across Runware, Novita, SCX.ai, and Alibaba Cloud.
Read more about Gemini 3.8 Flash, Muse Spark 1.3 & More Models →
The dashboard usage chart now overlays a comparison period, whether the previous period, a chosen week or month, or an exact custom range, and switches between a total view and a token-cost breakdown. Bars are grouped and stacked with an explicit legend, and rankings gain a hover-isolating legend and an all-time top apps panel.
Read more about Compare Usage Across Periods →
Sign in to the LLM Gateway CLI from your browser or enterprise SSO instead of typing a password, and pull your organization's shared skills into Claude Code, Codex, OpenCode, Cursor, and other agents with one command. Browser login works on every plan; organization skills are available on the Enterprise plan.
Read more about CLI Browser Login and Organization Skills →
Routing learns cache-hit rates and output-to-input proportions from recent project/model usage to compare providers for large prompts and sessions. Available automatically across plans, with workload defaults before enough history exists and explicit overrides on Enterprise.
Read more about Adaptive Cache-Aware Provider Selection →
@llmgateway/ai-sdk-provider 4.0 targets Vercel AI SDK 7 and adds llmgateway.video() for experimental_generateVideo: the provider submits a gateway video job, the SDK polls it, and you get the MP4 bytes back, with image-to-video, first and last frames, reference inputs, and audio control. Stay on 3.x for AI SDK 6.
Read more about AI SDK 7 Provider with Video Generation →
Enterprise organizations can now enforce zero data retention across provider routing, LLM Gateway storage, response caches, and the Responses API. Conflicting retention and caching settings are blocked before they can weaken the policy.
Read more about Zero Data Retention Controls →
Anthropic's Claude Fable 5.1 is live on the gateway with a 1M context window, always-on adaptive thinking, stronger long-horizon agentic work, and cache reads at a quarter of Fable 5's price.
Read more about Claude Fable 5.1 →
Group developers under one shared policy — a project ceiling, per-developer budgets, and IAM rules — instead of configuring each person by hand. Microsoft Entra groups map onto teams over SCIM, and a default team catches everyone who joins without one. Available on the Enterprise plan.
Read more about Organization Teams and Directory Sync →
Claude now routes through Microsoft Foundry under a new azure-anthropic provider. The models directory gained lifecycle status filters, model pages sort providers by price, speed, or context, and API key lists flag the keys that are near or at their limit.
Read more about Claude on Foundry, Model Status & More →
Gateway API keys are now stored only as keyed HMAC-SHA-256 fingerprints and provider credentials only as AES-256-GCM ciphertext. Every plaintext read path is gone, so a key's secret is visible exactly once per issuance — at creation or roll.
Read more about Hash-Only API Key Storage →
Showing 10 of 97 updates
Load more