49 features · one API
Everything the gateway does
Routing & reliability
One API, the right provider, every time.
Unified API Interface
One API for all LLM providers
Multi-Provider Support
Access 40+ LLM providers through one gateway
Self-Hosted or Cloud
Deploy anywhere
Anthropic-Compatible API
Point Claude Code at any model
Smart Routing & Fallback
The best provider, every request
Dynamic Routes
Routing logic, out of your code
Sessions
Sticky routing for whole conversations
Service Tiers
Trade latency for cost, per request
Caching
Pay once for repeated work
Request Timeouts
Per-attempt limits that suit agents
Custom Providers
Bring any OpenAI-compatible endpoint
Models & modalities
Text, images, video, audio, search and more.
Image Generation
Every image model, one endpoint
Video Generation
Async video jobs with signed callbacks
Speech Generation
Text to natural speech
Transcription
Speech to text with word timestamps
Realtime API
Speech-to-speech over WebSockets
Vision
Send images, get answers
Document Reading
Send PDFs straight to the model
OCR
Documents and images to markdown
Embeddings
Vectors for search and RAG
Rerank
Sharper retrieval in one call
Search API
Ranked web results with page content
Native Web Search
Live web answers with citations
Reasoning
Models that think before answering
Decisions
Typed answers, not text
Moderations
Classify unsafe text and images
Response Healing
Malformed JSON, repaired
Observability & cost
See every request, token and dollar.
Performance Monitoring
Track and optimize your LLM usage
Cost-Aware Analytics
Understand your LLM spending
Per-Model/Provider Breakdown
Granular usage insights
Errors & Reliability Monitoring
Ensure high availability
Project-Level Usage Explorer
Deep-dive into your usage
Cost Breakdown
The price of every request, in the response
Request Metadata
Tag requests, filter later
Source Attribution
Get credit for your traffic
Data Retention
Keep metadata, or keep everything
Data Streams
Logs to your SIEM and warehouse
Notifications
Know before it breaks
Security & governance
Control who calls what, and where data goes.
Secure Key Management
Centralized API key management
Enterprise Audit Logs
Complete visibility into every action
LLM Guardrails
Protect your AI applications
Compliance Policies
Only route to providers you trust
SSO & SCIM
Your identity provider, your rules
Project Access
Delegate projects, not the org
Master Keys
Provision everything from your backend
Org Models Directory
Every model your team can call
Build & monetize
Ship prompts, skills and payments faster.