Llama 3.1 70B Instruct

llama-3.1-70b-instruct
STABLE
128,000 context
Starting at $0.72/M input tokens
Starting at $0.72/M output tokens
Streaming

Providers for Llama 3.1 70B Instruct

LLM Gateway routes requests to the best providers that are able to handle your prompt size and parameters.

AWS Bedrock

aws-bedrock/llama-3.1-70b-instruct
Context
128k
Input
$0.72
Output
$0.72
    llama-3.1-70b-instruct - LLM Gateway