Compact open Llama model for lightweight chat, drafting, and self-hosting
https://router.huggingface.co/v1 meta-llama-3-1-8b-instruct Meta-Llama-3.1-8B-Instruct is listed for chat workloads and supports a 128K context window.
Check Hugging Face's current endpoint status before integrating this listing. Use the alternatives table if the provider listing is unavailable.
We found 2 provider listings for llama-3-1-8b-instruct. Check model ID, quota, pricing, and API format before switching providers.
| Provider | Model listing | Access | Context | API | Limits |
|---|---|---|---|---|---|
| | Meta-Llama-3.1-8B-Instruct | Check provider | 128K | Native | Credit-metered |
| | @cf/meta/llama-3.1-8b-instruct-fp8 | Free tier | 8K | Native | Varies |
| Model | Provider | Context | Access |
|---|---|---|---|
| @cf/meta/llama-3.1-8b-instruct-fp8 | Cloudflare Workers AI | 8K | Free tier |
| gemma-3-4b-it | Hugging Face | 131K | Check provider |
| phi-4 | Hugging Face | 16K | Check provider |
| Qwen2.5-Coder-7B-Instruct | Hugging Face | 131K | Check provider |
| Qwen2.5-7B-Instruct | Hugging Face | 131K | Check provider |
Meta-Llama-3.1-8B-Instruct is tagged for chat in this catalog and works with OpenAI-compatible client libraries.
Meta-Llama-3.1-8B-Instruct appears in the free model catalog for Hugging Face, but its current endpoint availability should be confirmed with the provider before use.
The model ID shown in this catalog is meta-llama-3-1-8b-instruct.
The listed free tier limit is Credit-metered. Limits can change per account tier, so confirm against the provider dashboard.
The listed context window is 128K tokens with up to 4K output tokens.
Meta Llama 3.1 8B is available free through Hugging Face's Serverless Inference API, providing access to the full 128K-context model without setting up your own infrastructure. The HF API is not OpenAI SDK-compatible (uses Hugging Face's own format), so it requires HF-specific client code or the huggingface_hub Python library. Rate limits are approximately 1,000 requests per day — sufficient for prototyping, evaluation, and low-volume applications. Registration required; free for public models.
For API keys, setup steps, and provider-level limits, see the Hugging Face provider page.