Meta: Llama-3.1-70B-Instruct

Quickstart

Use your Moduck API Key, set the API base URL to https://api.moduck.ai/v1, and set the model parameter to meta/llama-3.1-70b-instruct.

import os
import requests

base_url = "https://api.moduck.ai/v1"
api_key = os.environ["MODUCK_API_KEY"]
model_id = "meta/llama-3.1-70b-instruct"

response = requests.post(
    f"{base_url}/chat/completions",
    headers={
        "Authorization": f"Bearer {api_key}",
        "Content-Type": "application/json",
    },
    json={
        "model": model_id,
        "messages": [{"role": "user", "content": "Hello!"}],
        "stream": False,
    },
    timeout=60,
)
response.raise_for_status()
print(response.json())

Use the familiar OpenAI-style chat request format to make model integration easier.

Llama-3.1-70B-Instruct API Pricing

Benchmarks

Performance

Measured on the Moduck gateway across live traffic, hour by hour over the last 24 hours. Time to first token is how long before anything appears; throughput is how fast the answer is written after that; end-to-end latency is the whole round trip. Figures are medians unless the card says otherwise.

Artificial Analysis measurement

Availability

Uptime is the share of time at least one provider serving this model responded. Availability is stricter: the share of requests actually served. A provider that answers but fails part of the traffic lowers availability without lowering uptime. Both cover the last three days.

Llama-3.1-70B-Instruct Compare models

Model specifications

Input

text

Output

text

Context window

128,000

Maximum output

4,096

Release date

2024-07-23

Attachments

No

Reasoning

No

Tool calling

Yes

Temperature setting

Yes

Open weights

Yes

Frequently asked questions

Related models

Llama-3.3-70B-InstructMetaInputUSD 0.08 / 1M tokensOutputUSD 0.256 / 1M tokensView modelLlama-3.2-1BMetaInputUSD 0.08 / 1M tokensOutputUSD 0.08 / 1M tokensView modelLlama 3.2 1B InstructMetaInputUSD 0.0216 / 1M tokens · Context ≤ 60000 tokens · Maximum output 32000 tokensOutputUSD 0.1608 / 1M tokens · Context ≤ 60000 tokens · Maximum output 32000 tokensView model