Skip to content
Rapid Router
← All models

Llama 3.1 Nemotron 70B Instruct

nvidia/llama-3.1-nemotron-70b-instruct

NVIDIA model · Served by DeepInfra · live on the gateway

Try in chatGet API key
Input / 1M
$1.20
Output / 1M
$1.20
Context
128K tokens
Max output
8K tokens
Input
Text
Released
1y ago

Pricing

Input tokens$1.20 per 1M
Output tokens$1.20 per 1M
Provider list priceExactly what your balance is debited; our fee is charged when you buy credits

About Llama 3.1 Nemotron 70B Instruct

Nemotron model for efficient reasoning, coding, and specialized AI agents

Tools

What it supports

  • Tool calling (function calling)
  • JSON mode and structured output
  • Image input (vision)
  • Audio input
  • Extended reasoning
  • Streaming responses
  • OpenAI SDK, Anthropic SDK and any OpenAI-compatible client

Make a request

curl https://rapidrouter.ai/api/v1/chat/completions \
  -H "Authorization: Bearer $RAPIDROUTER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "nvidia/llama-3.1-nemotron-70b-instruct",
    "messages": [{ "role": "user", "content": "Hello" }]
  }'

Frequently asked

How do I call Llama 3.1 Nemotron 70B Instruct through an OpenAI-compatible API?

Point any OpenAI-compatible client at https://rapidrouter.ai/api/v1 with a Rapid Router API key and set the model to nvidia/llama-3.1-nemotron-70b-instruct. The chat completions endpoint is https://rapidrouter.ai/api/v1/chat/completions.

What is the context window of Llama 3.1 Nemotron 70B Instruct?

Llama 3.1 Nemotron 70B Instruct has a context window of 128,000 tokens on Rapid Router, and returns up to 8,192 output tokens per reply.

What can Llama 3.1 Nemotron 70B Instruct do?

On Rapid Router, Llama 3.1 Nemotron 70B Instruct supports tool calling.

More NVIDIA Nemotron models

Llama 3.3 Nemotron Super 49B v1.5$0.400/M in · $0.400/M outNemotron 3 Nano 30B A3B$0.050/M in · $0.200/M outNemotron 3 Nano Omni 30B A3B Reasoning$0.200/M in · $0.800/M outNemotron 3 Ultra 550B A55B$0.600/M in · $3.60/M outNemotron 4 340B Instruct$4.20/M in · $4.20/M outNemotron Content Safety 3.5$0.200/M in · $0.200/M outEvery NVIDIA model, priced →