Wizardlm 2 8x22b API

Python

from openai import OpenAI

client = OpenAI(api_key="YOUR_API_KEY", base_url="https://api.fastinfra.ai/v1")

response = client.chat.completions.create(
    model="microsoft/wizardlm-2-8x22b",
    messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)

curl

curl https://api.fastinfra.ai/v1/chat/completions \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "microsoft/wizardlm-2-8x22b",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

How much does the microsoft/wizardlm-2-8x22b API cost?

On FastInfra, microsoft/wizardlm-2-8x22b costs $0.651/1M input, $0.651/1M output tokens. Billing is per token used, with no subscription.

Is microsoft/wizardlm-2-8x22b compatible with the OpenAI SDK?

Yes. FastInfra exposes microsoft/wizardlm-2-8x22b through an OpenAI-compatible endpoint at https://api.fastinfra.ai/v1 — point any OpenAI SDK at that base URL with a FastInfra API key and keep your existing code.

How does routing work for microsoft/wizardlm-2-8x22b?

microsoft/wizardlm-2-8x22b is available on 1 route(s): route-07. Requests use route-07 by default (lowest cost). FastInfra fails over automatically if a route is unavailable.