Nvidia: Llama 3.1 Nemotron 70B Instruct

Nemotron model for efficient reasoning, coding, and specialized AI agents

Model lab: Nvidia
Model family: nemotron

Modalitiestext → text

Context window128,000

Maximum output8,192

InputUSD 0.48 / 1M tokens

OutputUSD 0.48 / 1M tokens

Try now

Quickstart

Use your Moduck API Key, set the API base URL to https://api.moduck.ai/v1, and set the model parameter to nvidia/llama-3.1-nemotron-70b-instruct.

import os
import requests

base_url = "https://api.moduck.ai/v1"
api_key = os.environ["MODUCK_API_KEY"]
model_id = "nvidia/llama-3.1-nemotron-70b-instruct"

response = requests.post(
    f"{base_url}/chat/completions",
    headers={
        "Authorization": f"Bearer {api_key}",
        "Content-Type": "application/json",
    },
    json={
        "model": model_id,
        "messages": [{"role": "user", "content": "Hello!"}],
        "stream": False,
    },
    timeout=60,
)
response.raise_for_status()
print(response.json())

Use the familiar OpenAI-style chat request format to make model integration easier.

Llama 3.1 Nemotron 70B Instruct API Pricing

Type	Price information
Input	USD 0.48 / 1M tokens
Output	USD 0.48 / 1M tokens

Performance

Performance trends

Throughput90.4 tok/sCurrent

Time to first token1.4 sCurrent

End-to-end latency7.2 sCurrent

Throughput

Current90.4 tok/s

Window average89.3 tok/s

Time to first token

Current1.4 s

Window average1.5 s

End-to-end latency

Current7.2 s

Window average7.5 s

Tail latency (P99)

Current14.6 s

Window average16.4 s

Prompt cache hit rate

Current31.2%

Window average22.7%

Error rate

Current0.0%

Window average0.1%

Availability

Uptime100%At least one provider responded

Availability100%Requests actually served

Error rate0%Share of failed requests

Served requests, hour by hour

24 hours agoNow

Llama 3.1 Nemotron 70B Instruct Compare models

Model	Input price	Output price	Context window	Capabilities
Llama 3.1 Nemotron 70B InstructThis page	USD 0.48 / 1M tokens	USD 0.48 / 1M tokens	128,000	Text output · Tool calling
Nemotron 3.5 Lightning 30B A3B	USD 0.04 / 1M tokens	USD 0.16 / 1M tokens	262,144	Text output · Reasoning · Tool calling
Nemotron 3 Ultra 550B A55B	USD 0.4 / 1M tokens	USD 1.76 / 1M tokens	1,000,000	Text output · Reasoning · Tool calling
Nemotron 3 Super 120B A12B	USD 0.096 / 1M tokens	USD 0.416 / 1M tokens	262,144	Text output · Reasoning · Tool calling
Nemotron 3 Nano 30B A3B	USD 0.04 / 1M tokens	USD 0.16 / 1M tokens	262,144	Text output · Reasoning · Tool calling

Model specifications

Input: text
Output: text
Context window: 128,000
Maximum output: 8,192
Release date: 2025-04-15
Attachments: No
Reasoning: No
Tool calling: Yes
Temperature setting: Yes
Open weights: Yes

Frequently asked questions

What is Llama 3.1 Nemotron 70B Instruct for?

Nemotron model for efficient reasoning, coding, and specialized AI agents

What inputs and outputs does Llama 3.1 Nemotron 70B Instruct support?

Recorded inputs: text; outputs: text.

How is Llama 3.1 Nemotron 70B Instruct priced?

The pricing table shows the current recorded Moduck price. For example: Input USD 0.48 / 1M tokens; Output USD 0.48 / 1M tokens. See the pricing table for all units, variants, and conditions.

What specifications are recorded for Llama 3.1 Nemotron 70B Instruct?

Current model records list Context window 128,000 tokens; Maximum output 8,192 tokens.

What model parameter does the Quickstart use?

The example uses nvidia/llama-3.1-nemotron-70b-instruct. This value comes from the page identifier and is not confirmed as a callable Moduck public ID.

Can I call this model through the Moduck API now?

This page has no verified Moduck API call for this model. A Quickstart example or reserved ID does not establish access; check the models available to your account.