Google: Gemma 2 27B

Quickstart

Use your Moduck API Key, set the API base URL to https://api.moduck.ai/v1, and set the model parameter to google/gemma-2-27b-it.

import os
import requests

base_url = "https://api.moduck.ai/v1"
api_key = os.environ["MODUCK_API_KEY"]
model_id = "google/gemma-2-27b-it"

response = requests.post(
    f"{base_url}/chat/completions",
    headers={
        "Authorization": f"Bearer {api_key}",
        "Content-Type": "application/json",
    },
    json={
        "model": model_id,
        "messages": [{"role": "user", "content": "Hello!"}],
        "stream": False,
    },
    timeout=60,
)
response.raise_for_status()
print(response.json())

Use the familiar OpenAI-style chat request format to make model integration easier.

Gemma 2 27B API Pricing

Performance

Measured on the Moduck gateway across live traffic, hour by hour over the last 24 hours. Time to first token is how long before anything appears; throughput is how fast the answer is written after that; end-to-end latency is the whole round trip. Figures are medians unless the card says otherwise.

Availability

Uptime is the share of time at least one provider serving this model responded. Availability is stricter: the share of requests actually served. A provider that answers but fails part of the traffic lowers availability without lowering uptime. Both cover the last three days.

Gemma 2 27B Compare models

Model specifications

Input

text

Output

text

Context window

8,192

Maximum output

2,048

Release date

2024-07-13

Attachments

No

Reasoning

No

Tool calling

No

Structured output

Yes

Temperature setting

Yes

Open weights

Yes

Frequently asked questions

Related models

No related catalog models are recorded for this model family.