NVIDIA NIM logo

llama-3.1-70b-instruct API status on NVIDIA NIM

Check provider
Available from NVIDIA NIM
★★★★★★★★★★ 3.5 Benchmark-backed score

Llama 3.1 70B Instruct is available free on NVIDIA NIM with up to 40 RPM and no daily token cap.

Check providerOpenAI compatibleTool callingJSON modeText
Check Provider Compare Save API Key
API Details

Copy-ready connection details

Use these values in your client or SDK.
Base URL
https://integrate.api.nvidia.com/v1
Model ID
meta/llama-3.1-70b-instruct
API format OpenAI Chat Completions
Technical Details

llama-3.1-70b-instruct specifications

Provider catalog
Context window 131K
Max output 16K
Status Check provider
Family llama-3-1-70b-instruct
Released Jul 23, 2024
Last updated Aug 6, 2026
Free listing since Jul 23, 2024
Input text
Output text
Capabilities tool calling, structured output
AI Recommendation

Should you use llama-3.1-70b-instruct?

llama-3.1-70b-instruct is listed for chat workloads and supports a 131K context window.

Check NVIDIA NIM's current endpoint status before integrating this listing. Use the alternatives table if the provider listing is unavailable.

Best for
  • Chat
Strengths & Weaknesses

Strengths

  • Long context window
  • Tool calling support
  • Structured JSON output
  • Works with OpenAI-style SDKs

Watch outs

  • Current endpoint availability needs provider confirmation
  • Free-tier rate limits apply
  • Vision support is not listed
Benchmark Overview

Benchmark signals for llama-3.1-70b-instruct

Measured data
Intelligence General reasoning and instruction following
12.5/100
Coding Programming and code generation
10.9/100
Agentic Tool use and multi-step tasks
5.1/100
Speed Observed generation speed
58 tok/s
Context Maximum listed context window
131K
Pricing

llama-3.1-70b-instruct pricing per 1M tokens

Check provider
Input $0.56 per 1M tokens
Output $0.56 per 1M tokens
Free access Check provider NVIDIA NIM
Rate limit Up to 40 RPM provider policy
Availability

llama-3.1-70b-instruct availability by provider

3 alternatives

We found 4 provider listings for llama-3-1-70b-instruct. Check model ID, quota, pricing, and API format before switching providers.

Provider Model listing Access Context API Limits
NVIDIA NIM meta/llama-3.1-70b-instruct Check provider 131K OpenAI-style Up to 40 RPM
Chutes.ai Llama 3.1 70B Free tier 131K OpenAI-style Community-powered, no hard cap
Glhf.chat Llama 3.1 70B Free tier 131K OpenAI-style Unlimited for free models
Cerebras Llama 3.1 70B Free tier 131K OpenAI-style See provider page
View NVIDIA NIM setup guide →
Typical Use Cases

llama-3.1-70b-instruct use cases

Chat

llama-3.1-70b-instruct is tagged for chat in this catalog and works with OpenAI-compatible client libraries.

FAQ

llama-3.1-70b-instruct free API FAQ

Is llama-3.1-70b-instruct free to use?

llama-3.1-70b-instruct appears in the free model catalog for NVIDIA NIM, but its current endpoint availability should be confirmed with the provider before use.

What is the llama-3.1-70b-instruct model ID?

The model ID shown in this catalog is meta/llama-3.1-70b-instruct.

What are the llama-3.1-70b-instruct free tier rate limits on NVIDIA NIM?

The listed free tier limit is Up to 40 RPM. Limits can change per account tier, so confirm against the provider dashboard.

What context window does llama-3.1-70b-instruct support?

The listed context window is 131K tokens with up to 16K output tokens.

Related Models

Related free models similar to llama-3.1-70b-instruct

View all models
Llama 3.1 70B Chutes.ai · 131K · Free tier Llama 3.1 70B Glhf.chat · 131K · Free tier Llama 3.1 70B Cerebras · 131K · Free tier 01-ai/yi-large NVIDIA NIM · 131K · Free tier adept/fuyu-8b NVIDIA NIM · 131K · Free tier ai21labs/jamba-1.5-large-instruct NVIDIA NIM · 131K · Free tier

More about llama-3.1-70b-instruct

Llama 3.1 70B Instruct is available free on NVIDIA NIM with up to 40 RPM and no daily token cap. A proven 70B workhorse for general chat, content generation, and analysis — NVIDIA's hosting provides reliable API access to Meta's flagship dense model. OpenAI-compatible endpoint. Requires free NVIDIA Developer Program membership and phone verification for API key.

For API keys, setup steps, and provider-level limits, see the NVIDIA NIM provider page.