Nousresearch: Hermes 3 70B Instruct

Open Llama instruction model for multilingual chat, reasoning, and coding

Model lab: Nousresearch
Model family: nousresearch

Modalitiestext → text

Context window131,072

Maximum output16,384

InputUSD 0.56 / 1M tokens

OutputUSD 0.56 / 1M tokens

Try now View docs

Quickstart

Use your Moduck API Key, set the API base URL to https://api.moduck.ai/v1, and set the model parameter to moduck/nousresearch/hermes-3-llama-3-1-70b.

import os
import requests

base_url = "https://api.moduck.ai/v1"
api_key = os.environ["MODUCK_API_KEY"]
model_id = "moduck/nousresearch/hermes-3-llama-3-1-70b"

response = requests.post(
    f"{base_url}/chat/completions",
    headers={
        "Authorization": f"Bearer {api_key}",
        "Content-Type": "application/json",
    },
    json={
        "model": model_id,
        "messages": [{"role": "user", "content": "Hello!"}],
        "stream": False,
    },
    timeout=60,
)
response.raise_for_status()
print(response.json())

Use the familiar OpenAI-style chat request format to make model integration easier.

Hermes 3 70B Instruct API Pricing

Type	Price information
Input	USD 0.56 / 1M tokens
Output	USD 0.56 / 1M tokens

Benchmarks

Intelligence Index · v4.36

Coding Index—

Agentic Index—

Performance

Output speed27.49 tokens/s

Time to first token2.36 s

Time to first answer token—

End-to-end response time—

Performance trends

Throughput27.49 tok/sCurrent

Time to first token2.36 sCurrent

End-to-end latency6.9 sCurrent

Throughput

Current27.49 tok/s

Window average26.5 tok/s

Time to first token

Current2.36 s

Window average2.9 s

End-to-end latency

Current6.9 s

Window average7.5 s

Tail latency (P99)

Current13.7 s

Window average16.6 s

Prompt cache hit rate

Current18.2%

Window average24.5%

Error rate

Current0.0%

Window average0.1%

Availability

Uptime100%At least one provider responded

Availability100%Requests actually served

Error rate0%Share of failed requests

Served requests, hour by hour

24 hours agoNow

Hermes 3 70B Instruct Compare models

Model	Input price	Output price	Context window	Capabilities
Hermes 3 70B InstructThis page	USD 0.56 / 1M tokens	USD 0.56 / 1M tokens	131,072	Text output
Hermes 3 405B Instruct	USD 0.8 / 1M tokens	USD 0.8 / 1M tokens	131,072	Text output
Hermes 4 405B	USD 0.24 / 1M tokens · Context ≤ 128000 tokens · Maximum output 8192 tokens · Maximum input 128000 tokens	USD 0.96 / 1M tokens · Context ≤ 128000 tokens · Maximum output 8192 tokens · Maximum input 128000 tokens	131,072	Text output · Reasoning
Hermes 2 Pro Llama 3 8B	USD 0.112 / 1M tokens	USD 0.112 / 1M tokens	8,192	Text output · Tool calling
Beam 1.0 501B A23B	USD 0.2 / 1M tokens	USD 0.8 / 1M tokens	1,048,576	Text output · Reasoning · Tool calling

Model specifications

Input: text
Output: text
Context window: 131,072
Maximum output: 16,384
Release date: 2024-08-18
Attachments: No
Reasoning: No
Tool calling: No
Structured output: Yes
Temperature setting: Yes
Open weights: Yes

Frequently asked questions

What is Hermes 3 70B Instruct for?

Open Llama instruction model for multilingual chat, reasoning, and coding

What inputs and outputs does Hermes 3 70B Instruct support?

Recorded inputs: text; outputs: text.

How is Hermes 3 70B Instruct priced?

The pricing table shows the current recorded Moduck price. For example: Input USD 0.56 / 1M tokens; Output USD 0.56 / 1M tokens. See the pricing table for all units, variants, and conditions.

What specifications are recorded for Hermes 3 70B Instruct?

Current model records list Context window 131,072 tokens; Maximum output 16,384 tokens.

What model parameter does the Quickstart use?

The example uses moduck/nousresearch/hermes-3-llama-3-1-70b. This is a cataloged Moduck public or reserved ID; check your account’s available models before calling it.

Can I call this model through the Moduck API now?

This page has no verified Moduck API call for this model. A Quickstart example or reserved ID does not establish access; check the models available to your account.