Back to all models

Llama 3.1 70B Instruct

Mid-size Llama 3.1 with balanced performance.

llama-3.1-70b-instruct
STABLE
128,000 context
Starting at $0.72/M input tokens
Starting at $0.72/M output tokens
Streaming

Select Provider

All Providers for Llama 3.1 70B Instruct

LLM Gateway routes requests to the best providers that are able to handle your prompt size and parameters.

AWS Bedrock

UNSTABLE
aws-bedrock/llama-3.1-70b-instruct
Context Size
128k
Stability
unstable
Pricing
Input
$0.72
/M
Cached
—
Output
$0.72
/M
Per Request
$0.000
/req
Capabilities
Streaming
Try in Playground