Groq Provider

Groq's ultra-fast LPU inference with various models

Available Models

gpt-oss-120b

openai/gpt-oss-120b

groq/gpt-oss-120b

Context: 131.1k

$0.15 in/$0.75 out

gpt-oss-20b

openai/gpt-oss-20b

groq/gpt-oss-20b

Context: 131.1k

$0.10 in/$0.50 out

gemma2-9b-it

groq/gemma2-9b-it

Context: 8.1k

$0.20 in/$0.20 out

llama-guard-4-12b

meta-llama/llama-guard-4-12b

groq/llama-guard-4-12b

Context: 131.1k

$0.20 in/$0.20 out

deepseek-r1-distill-llama-70b

groq/deepseek-r1-distill-llama-70b

Context: 131.1k

$0.75 in/$0.99 out