Skip to content
Rapid Router
← All models

Llama 3 70B Instruct

meta-llama/meta-llama-3-70b-instruct

Meta model · Served by DeepInfra · live on the gateway

Try in chatGet API key
Input / 1M
$0.300
Output / 1M
$0.400
Context
8K tokens
Max output
8K tokens
Input
Text
Released
2y ago

Pricing

Input tokens$0.300 per 1M
Output tokens$0.400 per 1M
Provider list priceExactly what your balance is debited; our fee is charged when you buy credits

About Llama 3 70B Instruct

Open Llama instruction model for multilingual chat, reasoning, and coding

What it supports

  • Tool calling (function calling)
  • JSON mode and structured output
  • Image input (vision)
  • Audio input
  • Extended reasoning
  • Streaming responses
  • OpenAI SDK, Anthropic SDK and any OpenAI-compatible client

Make a request

curl https://rapidrouter.ai/api/v1/chat/completions \
  -H "Authorization: Bearer $RAPIDROUTER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "meta-llama/meta-llama-3-70b-instruct",
    "messages": [{ "role": "user", "content": "Hello" }]
  }'

Frequently asked

How do I call Llama 3 70B Instruct through an OpenAI-compatible API?

Point any OpenAI-compatible client at https://rapidrouter.ai/api/v1 with a Rapid Router API key and set the model to meta-llama/meta-llama-3-70b-instruct. The chat completions endpoint is https://rapidrouter.ai/api/v1/chat/completions.

What is the context window of Llama 3 70B Instruct?

Llama 3 70B Instruct has a context window of 8,192 tokens on Rapid Router, and returns up to 8,000 output tokens per reply.

What can Llama 3 70B Instruct do?

On Rapid Router, Llama 3 70B Instruct supports JSON mode.

More Llama models

Llama 2 13B Chat Hf$0.130/M in · $0.130/M outLlama 2 70B Chat Hf$0.640/M in · $0.800/M outLlama 3.2 11B Vision Instruct$0.345/M in · $0.345/M outLlama 3.2 1B Instruct$0.005/M in · $0.010/M outLlama 3.2 1B Instruct (free)Free/M in · Free/M outLlama 3.2 3B Instruct$0.020/M in · $0.020/M outEvery Meta model, priced →