Meta Llama 3.1 8B Instruct (GGUF) API
About
Process massive datasets with Meta Llama 3.1 8B Instruct (GGUF), featuring an expansive 131K context window for long-document analysis. This model delivers available completely free of charge, native tool calling support, open weights architecture. Access Meta Llama 3.1 8B Instruct (GGUF) via the Atomic Chat API with up to 4K output tokens.
Capabilities
Input Modalities
text
Output Modalities
text
Reasoning
No
Structured Output
No
Tool Use
Yes
WeightsOpen
Limits
Context Window
131K
Tokens
Input Limit
131K
Tokens
Max Output
4K
Tokens
Pricing
Standard (per 1M tokens)
Input
Free
Output
Free
Frequently Asked Questions
Meta Llama 3.1 8B Instruct (GGUF) by Atomic Chat costs Free per 1M input tokens and Free per 1M output tokens.
Model Details
ID
Meta-Llama-3_1-8B-Instruct-GGUF
Provider
Atomic ChatFamily
llama
Release Date
Jul 23, 2024
Knowledge Cutoff
N/A
API Integration
NPM Package
@ai-sdk/openai-compatible
Environment Variables
ATOMIC_CHAT_API_KEY
API Base URL
http://127.0.0.1:1337/v1