Llama 3.1 8B Instruct

llama-3.1-8b-instruct
STABLE
128,000 context
Starting at $0.02/M input tokens
Starting at $0.06/M output tokens
Streaming
Tools

Providers for Llama 3.1 8B Instruct

LLM Gateway routes requests to the best providers that are able to handle your prompt size and parameters.

AWS Bedrock

aws-bedrock/llama-3.1-8b-instruct
Context
128k
Input
$0.22
Output
$0.22
Capabilities
Streaming

Nebius AI

nebius/llama-3.1-8b-instruct
Context
128k
Input
$0.02
Output
$0.06
Capabilities
Streaming

Inference.net

inference.net/llama-3.1-8b-instruct
Context
128k
Input
$0.07
Output
$0.33
Capabilities
Streaming

Together AI

together.ai/llama-3.1-8b-instruct
Context
128k
Input
$0.06
Output
$0.06
Capabilities
Streaming
Tools