Llama 3.1 405B API

Run meta-llama/Llama-3.1-405B through FastInfra's OpenAI-compatible API. Pay per token, no subscription, routed to the cheapest available provider.

Read the docs
Pricing

Llama 3.1 405B pricing

Billed per token used. Prices sync automatically from wholesale providers.

Direction Price per 1M tokens
Input
Output
Availability

Served by 1 provider

Requests route to Together AI by default (cheapest). Pin a specific provider with the :provider suffix.

Provider Upstream model ID
together meta-llama/Llama-3.1-405B
Quickstart

Call Llama 3.1 405B in 30 seconds

Works with any OpenAI SDK — change the base URL and API key only.

Python

from openai import OpenAI

client = OpenAI(api_key="YOUR_API_KEY", base_url="https://api.fastinfra.ai/v1")

response = client.chat.completions.create(
    model="meta-llama/Llama-3.1-405B",
    messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)

curl

curl https://api.fastinfra.ai/v1/chat/completions \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "meta-llama/Llama-3.1-405B",
    "messages": [{"role": "user", "content": "Hello!"}]
  }'
FAQ

Llama 3.1 405B — common questions

How much does the meta-llama/Llama-3.1-405B API cost?

On FastInfra, meta-llama/Llama-3.1-405B costs Pay-per-token pricing via provider routing. Billing is per token used, with no subscription.

Is meta-llama/Llama-3.1-405B compatible with the OpenAI SDK?

Yes. FastInfra exposes meta-llama/Llama-3.1-405B through an OpenAI-compatible endpoint at https://api.fastinfra.ai/v1 — point any OpenAI SDK at that base URL with a FastInfra API key and keep your existing code.

Which providers serve meta-llama/Llama-3.1-405B?

meta-llama/Llama-3.1-405B is available from 1 provider(s): together. Requests route to Together AI by default (cheapest); append ":provider" to the model ID to pin one.