Llama 3.1 Nemotron 70B Instruct HF API
Run nvidia/Llama-3.1-Nemotron-70B-Instruct-HF through FastInfra's OpenAI-compatible API.
Pay per token, no subscription, routed to the cheapest available provider.
Llama 3.1 Nemotron 70B Instruct HF pricing
Billed per token used. Prices sync automatically from wholesale providers.
| Direction | Price per 1M tokens |
|---|---|
| Input | $0.92 |
| Output | $0.92 |
Served by 1 provider
Requests route to Together AI by default (cheapest).
Pin a specific provider with the :provider suffix.
| Provider | Upstream model ID |
|---|---|
| together | nvidia/Llama-3.1-Nemotron-70B-Instruct-HF |
Call Llama 3.1 Nemotron 70B Instruct HF in 30 seconds
Works with any OpenAI SDK — change the base URL and API key only.
Python
from openai import OpenAI
client = OpenAI(api_key="YOUR_API_KEY", base_url="https://api.fastinfra.ai/v1")
response = client.chat.completions.create(
model="nvidia/Llama-3.1-Nemotron-70B-Instruct-HF",
messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)curl
curl https://api.fastinfra.ai/v1/chat/completions \
-H "Authorization: Bearer YOUR_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "nvidia/Llama-3.1-Nemotron-70B-Instruct-HF",
"messages": [{"role": "user", "content": "Hello!"}]
}'Llama 3.1 Nemotron 70B Instruct HF — common questions
How much does the nvidia/Llama-3.1-Nemotron-70B-Instruct-HF API cost?
On FastInfra, nvidia/Llama-3.1-Nemotron-70B-Instruct-HF costs $0.924/1M input, $0.924/1M output tokens. Billing is per token used, with no subscription.
Is nvidia/Llama-3.1-Nemotron-70B-Instruct-HF compatible with the OpenAI SDK?
Yes. FastInfra exposes nvidia/Llama-3.1-Nemotron-70B-Instruct-HF through an OpenAI-compatible endpoint at https://api.fastinfra.ai/v1 — point any OpenAI SDK at that base URL with a FastInfra API key and keep your existing code.
Which providers serve nvidia/Llama-3.1-Nemotron-70B-Instruct-HF?
nvidia/Llama-3.1-Nemotron-70B-Instruct-HF is available from 1 provider(s): together. Requests route to Together AI by default (cheapest); append ":provider" to the model ID to pin one.
Related models
Compare side by side: Llama 3.1 Nemotron 70B Instruct HF vs Llama Nemotron Embed Vl 1b v2 · Llama 3.1 Nemotron 70B Instruct HF vs Nemotron 3 Nano 30b a3b · Llama 3.1 Nemotron 70B Instruct HF vs NVIDIA Nemotron 3.5 Lightning