Llama 3.1 405B Instruct API

Run meta-llama/Llama-3.1-405B-Instruct through FastInfra's OpenAI-compatible API. Pay per token, no subscription, routed to the cheapest available provider.

Read the docs
Pricing

Llama 3.1 405B Instruct pricing

Billed per token used. Prices sync automatically from wholesale providers.

Direction Price per 1M tokens
Input$3.68
Output$3.68
Availability

Served by 1 provider

Requests route to Together AI by default (cheapest). Pin a specific provider with the :provider suffix.

Provider Upstream model ID
together meta-llama/Llama-3.1-405B-Instruct
Quickstart

Call Llama 3.1 405B Instruct in 30 seconds

Works with any OpenAI SDK — change the base URL and API key only.

Python

from openai import OpenAI

client = OpenAI(api_key="YOUR_API_KEY", base_url="https://api.fastinfra.ai/v1")

response = client.chat.completions.create(
    model="meta-llama/Llama-3.1-405B-Instruct",
    messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)

curl

curl https://api.fastinfra.ai/v1/chat/completions \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "meta-llama/Llama-3.1-405B-Instruct",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'
FAQ

Llama 3.1 405B Instruct — common questions

How much does the meta-llama/Llama-3.1-405B-Instruct API cost?

On FastInfra, meta-llama/Llama-3.1-405B-Instruct costs $3.675/1M input, $3.675/1M output tokens. Billing is per token used, with no subscription.

Is meta-llama/Llama-3.1-405B-Instruct compatible with the OpenAI SDK?

Yes. FastInfra exposes meta-llama/Llama-3.1-405B-Instruct through an OpenAI-compatible endpoint at https://api.fastinfra.ai/v1 — point any OpenAI SDK at that base URL with a FastInfra API key and keep your existing code.

Which providers serve meta-llama/Llama-3.1-405B-Instruct?

meta-llama/Llama-3.1-405B-Instruct is available from 1 provider(s): together. Requests route to Together AI by default (cheapest); append ":provider" to the model ID to pin one.