Meta Llama 3.1 8B Instruct Turbo
meta-llama/
Meta model · Served by DeepInfra · live on the gateway · :free available
Pricing
About Meta Llama 3.1 8B Instruct Turbo
Compact Llama instruction model for fast chat and local deployment
What it supports
- Tool calling (function calling)
- JSON mode and structured output
- Image input (vision)
- Audio input
- Extended reasoning
- Streaming responses
- OpenAI SDK, Anthropic SDK and any OpenAI-compatible client
Make a request
curl https://rapidrouter.ai/api/v1/chat/completions \
-H "Authorization: Bearer $RAPIDROUTER_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "meta-llama/meta-llama-3.1-8b-instruct-turbo",
"messages": [{ "role": "user", "content": "Hello" }]
}'Frequently asked
How do I call Meta Llama 3.1 8B Instruct Turbo through an OpenAI-compatible API?
Point any OpenAI-compatible client at https://rapidrouter.ai/api/v1 with a Rapid Router API key and set the model to meta-llama/meta-llama-3.1-8b-instruct-turbo. The chat completions endpoint is https://rapidrouter.ai/api/v1/chat/completions.
What is the context window of Meta Llama 3.1 8B Instruct Turbo?
Meta Llama 3.1 8B Instruct Turbo has a context window of 128,000 tokens on Rapid Router, and returns up to 128,000 output tokens per reply.
Is there a free version of Meta Llama 3.1 8B Instruct Turbo?
Yes. Call meta-llama/meta-llama-3.1-8b-instruct-turbo:free and the request is paid for from Rapid Router's sponsored daily pool, within the free tier's daily request limit.
What can Meta Llama 3.1 8B Instruct Turbo do?
On Rapid Router, Meta Llama 3.1 8B Instruct Turbo supports tool calling.