← All models
Llama-3.1-8B-Instruct
novita/
Novita model · Served by Novita · live on the gateway
Input / 1M
$0.020
Output / 1M
$0.050
Context
131K tokens
Max output
118K tokens
Input
Text
Released
2y ago
Pricing
Input tokens$0.020 per 1M
Output tokens$0.050 per 1M
Provider list priceExactly what your balance is debited; our fee is charged when you buy credits
About Llama-3.1-8B-Instruct
Open Llama instruction model for multilingual chat, reasoning, and coding
Tools
What it supports
- Tool calling (function calling)
- JSON mode and structured output
- Image input (vision)
- Audio input
- Extended reasoning
- Streaming responses
- OpenAI SDK, Anthropic SDK and any OpenAI-compatible client
Make a request
curl https://rapidrouter.ai/api/v1/chat/completions \
-H "Authorization: Bearer $RAPIDROUTER_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "novita/meta-llama/llama-3.1-8b-instruct",
"messages": [{ "role": "user", "content": "Hello" }]
}'Frequently asked
How do I call Llama-3.1-8B-Instruct through an OpenAI-compatible API?
Point any OpenAI-compatible client at https://rapidrouter.ai/api/v1 with a Rapid Router API key and set the model to novita/meta-llama/llama-3.1-8b-instruct. The chat completions endpoint is https://rapidrouter.ai/api/v1/chat/completions.
What is the context window of Llama-3.1-8B-Instruct?
Llama-3.1-8B-Instruct has a context window of 131,072 tokens on Rapid Router, and returns up to 117,964 output tokens per reply.
What can Llama-3.1-8B-Instruct do?
On Rapid Router, Llama-3.1-8B-Instruct supports tool calling, JSON mode.