Llama-3.1-70B-Instruct

meta-llama/meta-llama-3.1-70b-instruct

Meta model · Served by DeepInfra · live on the gateway

Try in chat Get API key

Input / 1M

$0.400

Output / 1M

$0.400

Context

131K tokens

Max output

16K tokens

Input

Text

Released

2y ago

Pricing

Input tokens$0.400 per 1M

Output tokens$0.400 per 1M

Provider list priceExactly what your balance is debited; our fee is charged when you buy credits

About Llama-3.1-70B-Instruct

Open Llama instruction model for multilingual chat, reasoning, and coding

Tools

What it supports

Tool calling (function calling)
JSON mode and structured output
Image input (vision)
Audio input
Extended reasoning
Streaming responses
OpenAI SDK, Anthropic SDK and any OpenAI-compatible client

Make a request

curl https://rapidrouter.ai/api/v1/chat/completions \
  -H "Authorization: Bearer $RAPIDROUTER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "meta-llama/meta-llama-3.1-70b-instruct",
    "messages": [{ "role": "user", "content": "Hello" }]
  }'

Frequently asked

How do I call Llama-3.1-70B-Instruct through an OpenAI-compatible API?

Point any OpenAI-compatible client at https://rapidrouter.ai/api/v1 with a Rapid Router API key and set the model to meta-llama/meta-llama-3.1-70b-instruct. The chat completions endpoint is https://rapidrouter.ai/api/v1/chat/completions.

What is the context window of Llama-3.1-70B-Instruct?

Llama-3.1-70B-Instruct has a context window of 131,072 tokens on Rapid Router, and returns up to 16,384 output tokens per reply.

What can Llama-3.1-70B-Instruct do?

On Rapid Router, Llama-3.1-70B-Instruct supports tool calling, JSON mode.

More Llama models

Llama 2 13B Chat Hf$0.130/M in · $0.130/M out Llama 2 70B Chat Hf$0.640/M in · $0.800/M out Llama 3.2 11B Vision Instruct$0.345/M in · $0.345/M out Llama 3.2 1B Instruct$0.005/M in · $0.010/M out Llama 3.2 1B Instruct (free)Free/M in · Free/M out Llama 3.2 3B Instruct$0.020/M in · $0.020/M out Every Meta model, priced →