Nousresearch: Hermes 3 70B Instruct

Quickstart

Use your Moduck API Key, set the API base URL to https://api.moduck.ai/v1, and set the model parameter to moduck/nousresearch/hermes-3-llama-3-1-70b.

import os
import requests

base_url = "https://api.moduck.ai/v1"
api_key = os.environ["MODUCK_API_KEY"]
model_id = "moduck/nousresearch/hermes-3-llama-3-1-70b"

response = requests.post(
    f"{base_url}/chat/completions",
    headers={
        "Authorization": f"Bearer {api_key}",
        "Content-Type": "application/json",
    },
    json={
        "model": model_id,
        "messages": [{"role": "user", "content": "Hello!"}],
        "stream": False,
    },
    timeout=60,
)
response.raise_for_status()
print(response.json())

Use the familiar OpenAI-style chat request format to make model integration easier.

Hermes 3 70B Instruct API Pricing

Benchmarks

Performance

Measured on the Moduck gateway across live traffic, hour by hour over the last 24 hours. Time to first token is how long before anything appears; throughput is how fast the answer is written after that; end-to-end latency is the whole round trip. Figures are medians unless the card says otherwise.

Artificial Analysis measurement

Availability

Uptime is the share of time at least one provider serving this model responded. Availability is stricter: the share of requests actually served. A provider that answers but fails part of the traffic lowers availability without lowering uptime. Both cover the last three days.

Hermes 3 70B Instruct Compare models

Model specifications

Input

text

Output

text

Context window

131,072

Maximum output

16,384

Release date

2024-08-18

Attachments

No

Reasoning

No

Tool calling

No

Structured output

Yes

Temperature setting

Yes

Open weights

Yes

Frequently asked questions

Related models

Hermes 3 405B InstructNousresearchInputUSD 0.8 / 1M tokensOutputUSD 0.8 / 1M tokensView model