Compact open Llama model for lightweight chat, drafting, and self-hosting
https://integrate.api.nvidia.com/v1 meta/llama-3.1-8b-instruct llama-3.1-8b-instruct is listed for chat workloads and supports a 8K context window.
Check NVIDIA NIM's current endpoint status before integrating this listing. Use the alternatives table if the provider listing is unavailable.
We found 4 provider listings for llama-3-1-8b-instruct. Check model ID, quota, pricing, and API format before switching providers.
| Provider | Model listing | Access | Context | API | Limits |
|---|---|---|---|---|---|
| | meta/llama-3.1-8b-instruct | Check provider | 8K | Native | Varies |
| | Meta-Llama-3.1-8B-Instruct | Free tier | 128K | Native | Credit-metered |
| | @cf/meta/llama-3.1-8b-instruct-fp8 | Free tier | 8K | Native | Varies |
| | meta-Llama-3.1-8B-Instruct-Turbo | Free tier | 8K | Native | Varies |
| Model | Provider | Context | Access |
|---|---|---|---|
| Meta-Llama-3.1-8B-Instruct | Hugging Face | 128K | Free tier |
| @cf/meta/llama-3.1-8b-instruct-fp8 | Cloudflare Workers AI | 8K | Free tier |
| meta-Llama-3.1-8B-Instruct-Turbo | LLM7.io | 8K | Free tier |
| 01-ai/yi-large | NVIDIA NIM | 131K | Free tier |
| adept/fuyu-8b | NVIDIA NIM | 131K | Free tier |
llama-3.1-8b-instruct is tagged for chat in this catalog and works with OpenAI-compatible client libraries.
llama-3.1-8b-instruct appears in the free model catalog for NVIDIA NIM, but its current endpoint availability should be confirmed with the provider before use.
The model ID shown in this catalog is meta/llama-3.1-8b-instruct.
The listed context window is 8K tokens with up to 4K output tokens.
Meta Llama 3.1 8B is available free through Hugging Face's Serverless Inference API, providing access to the full 128K-context model without setting up your own infrastructure. The HF API is not OpenAI SDK-compatible (uses Hugging Face's own format), so it requires HF-specific client code or the huggingface_hub Python library. Rate limits are approximately 1,000 requests per day — sufficient for prototyping, evaluation, and low-volume applications. Registration required; free for public models.
For API keys, setup steps, and provider-level limits, see the NVIDIA NIM provider page.