Meta Llama 3.1 8B Instruct Turbo API

Python

from openai import OpenAI

client = OpenAI(api_key="YOUR_API_KEY", base_url="https://api.fastinfra.ai/v1")

response = client.chat.completions.create(
    model="meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo",
    messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)

curl

curl https://api.fastinfra.ai/v1/chat/completions \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

How much does the meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo API cost?

On FastInfra, meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo costs $0.021/1M input, $0.042/1M output tokens. Billing is per token used, with no subscription.

Is meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo compatible with the OpenAI SDK?

Yes. FastInfra exposes meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo through an OpenAI-compatible endpoint at https://api.fastinfra.ai/v1 — point any OpenAI SDK at that base URL with a FastInfra API key and keep your existing code.

How does routing work for meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo?

meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo is available on 2 route(s): route-21, route-03. Requests use route-21 by default (lowest cost). FastInfra fails over automatically if a route is unavailable.