Meta Llama 3 8B Instruct API

Python

from openai import OpenAI

client = OpenAI(api_key="YOUR_API_KEY", base_url="https://api.fastinfra.ai/v1")

response = client.chat.completions.create(
    model="meta-llama/Meta-Llama-3-8B-Instruct",
    messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)

curl

curl https://api.fastinfra.ai/v1/chat/completions \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "meta-llama/Meta-Llama-3-8B-Instruct",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'

How much does the meta-llama/Meta-Llama-3-8B-Instruct API cost?

On FastInfra, meta-llama/Meta-Llama-3-8B-Instruct costs $0.21/1M input, $0.21/1M output tokens. Billing is per token used, with no subscription.

Is meta-llama/Meta-Llama-3-8B-Instruct compatible with the OpenAI SDK?

Yes. FastInfra exposes meta-llama/Meta-Llama-3-8B-Instruct through an OpenAI-compatible endpoint at https://api.fastinfra.ai/v1 — point any OpenAI SDK at that base URL with a FastInfra API key and keep your existing code.

How does routing work for meta-llama/Meta-Llama-3-8B-Instruct?

meta-llama/Meta-Llama-3-8B-Instruct is available on 1 route(s): route-03. Requests use route-03 by default (lowest cost). FastInfra fails over automatically if a route is unavailable.