Microsoft: WizardLM 2 8x22B

Microsoft WizardLM instruction-tuned Mixtral MoE for multilingual dialogue and complex tasks

Model lab: Microsoft
Model family: —

Model resources

Hugging Face archive

Modalitiestext → text

Context window65,536

Maximum output8,000

InputUSD 0.384 / 1M tokens

OutputUSD 0.384 / 1M tokens

Try now

Quickstart

Use your Moduck API Key, set the API base URL to https://api.moduck.ai/v1, and set the model parameter to microsoft/wizardlm-2-8x22b.

import os
import requests

base_url = "https://api.moduck.ai/v1"
api_key = os.environ["MODUCK_API_KEY"]
model_id = "microsoft/wizardlm-2-8x22b"

response = requests.post(
    f"{base_url}/chat/completions",
    headers={
        "Authorization": f"Bearer {api_key}",
        "Content-Type": "application/json",
    },
    json={
        "model": model_id,
        "messages": [{"role": "user", "content": "Hello!"}],
        "stream": False,
    },
    timeout=60,
)
response.raise_for_status()
print(response.json())

Use the familiar OpenAI-style chat request format to make model integration easier.

WizardLM 2 8x22B API Pricing

Type	Price information
Input	USD 0.384 / 1M tokens
Output	USD 0.384 / 1M tokens

Performance

Measured on the Moduck gateway across live traffic, hour by hour over the last 24 hours. Time to first token is how long before anything appears; throughput is how fast the answer is written after that; end-to-end latency is the whole round trip. Figures are medians unless the card says otherwise.

Performance trends

Throughput87.2 tok/sCurrent

Time to first token1.2 sCurrent

End-to-end latency7.6 sCurrent

Throughput

Current87.2 tok/s

Window average89.4 tok/s

Time to first token

Current1.2 s

Window average1.4 s

End-to-end latency

Current7.6 s

Window average7.5 s

Tail latency (P99)

Current14.5 s

Window average16.9 s

Prompt cache hit rate

Current18.3%

Window average24.6%

Error rate

Current0.0%

Window average0.2%

Availability

Uptime is the share of time at least one provider serving this model responded. Availability is stricter: the share of requests actually served. A provider that answers but fails part of the traffic lowers availability without lowering uptime. Both cover the last three days.

Uptime100%At least one provider responded

Availability100%Requests actually served

Error rate0%Share of failed requests

Served requests, hour by hour

24 hours agoNow

WizardLM 2 8x22B Compare models

Model	Input price	Output price	Context window	Capabilities
WizardLM 2 8x22BThis page	USD 0.384 / 1M tokens	USD 0.384 / 1M tokens	65,536	Text output
MAI-Code-1-Flash	USD 0.6 / 1M tokens	USD 3.6 / 1M tokens	256,000	Text output · Reasoning · Tool calling
Phi-4-mini	USD 0.06 / 1M tokens	USD 0.24 / 1M tokens	128,000	Text output · Tool calling
Beam 1.0 501B A23B	USD 0.2 / 1M tokens	USD 0.8 / 1M tokens	1,048,576	Text output · Reasoning · Tool calling
Ling 3.1 Flash	USD 0.06 / 1M tokens	USD 0.176 / 1M tokens	262,144	Text output · Reasoning · Tool calling

Model specifications

Input: text
Output: text
Context window: 65,536
Maximum output: 8,000
Release date: 2024-04-15
Attachments: No
Reasoning: No
Tool calling: No
Temperature setting: Yes
Open weights: Yes

Frequently asked questions

What is WizardLM 2 8x22B for?

Microsoft WizardLM instruction-tuned Mixtral MoE for multilingual dialogue and complex tasks

What inputs and outputs does WizardLM 2 8x22B support?

Recorded inputs: text; outputs: text.

How is WizardLM 2 8x22B priced?

The pricing table shows the current recorded Moduck price. For example: Input USD 0.384 / 1M tokens; Output USD 0.384 / 1M tokens. See the pricing table for all units, variants, and conditions.

What specifications are recorded for WizardLM 2 8x22B?

Current model records list Context window 65,536 tokens; Maximum output 8,000 tokens.

What model parameter does the Quickstart use?

The example uses microsoft/wizardlm-2-8x22b. This value comes from the page identifier and is not confirmed as a callable Moduck public ID.

Can I call this model through the Moduck API now?

This page has no verified Moduck API call for this model. A Quickstart example or reserved ID does not establish access; check the models available to your account.