New Providers: Groq and xAI Support + Always-Visible Credits - Changelog - LLM Gateway

We're excited to announce support for two new AI providers, along with an improved credits experience in the dashboard.

🚀 New Provider: Groq

Groq brings ultra-fast inference speeds with their Language Processing Unit (LPU) technology. We've added support for the following Groq models:

All Groq models support streaming and JSON output, with competitive pricing starting at $0.20/1M tokens.

xAI's Grok models are now available through LLM Gateway, offering state-of-the-art performance:

grok-3
- Latest flagship model with 131K context ($3.00/$15.00 per 1M tokens)
grok-3-mini
- Efficient variant ($0.30/$0.50 per 1M tokens)
grok-3-fast
- Optimized for speed ($5.00/$25.00 per 1M tokens)
grok-3-mini-fast
- Fast and efficient ($0.60/$4.00 per 1M tokens)
grok-2-1212
- Previous generation model ($2.00/$10.00 per 1M tokens)
grok-2-vision-1212
- Vision-capable model with image support ($2.00/$10.00 per 1M tokens)

All Grok models support streaming and JSON output, with the vision model supporting image inputs.

Credits are now permanently displayed in the dashboard sidebar for quick access:

The credits display appears in the sidebar footer alongside your user menu, making it easy to monitor your usage and top up when needed.

Add Provider Keys: Navigate to Dashboard → Settings → Provider Keys to add your Groq or xAI API keys
Start Using Models: All new models are immediately available in the playground and via API
Monitor Usage: Keep track of your spending with the always-visible credits display

These additions bring our total to 12 supported providers with over 40+ models available through a single API endpoint.