Meta-Llama-3.1-8B-Instruct (Fast) API
About
Process massive datasets with Meta-Llama-3.1-8B-Instruct (Fast), featuring an expansive 128K context window for long-document analysis. This model delivers cost-effective pricing at $0.03/1M input and $0.09/1M output tokens, native tool calling support, open weights architecture. Access Meta-Llama-3.1-8B-Instruct (Fast) via the Nebius Token Factory API with up to 4K output tokens.
Capabilities
Input Modalities
text
Output Modalities
text
Reasoning
No
Structured Output
Yes
Tool Use
Yes
WeightsOpen
Temperature
Adjustable
Attachment
Not Supported
Limits
Context Window
128K
Tokens
Input Limit
120K
Tokens
Max Output
4K
Tokens
Pricing
Standard (per 1M tokens)
Input
$0.03
Output
$0.09
Caching (per 1M tokens)
Read
$0.0030
Write
$0.03
Frequently Asked Questions
Meta-Llama-3.1-8B-Instruct (Fast) by Nebius Token Factory costs $0.03 per 1M input tokens and $0.09 per 1M output tokens. Cached reads cost $0.0030 per 1M tokens. Cache writes cost $0.03 per 1M tokens.
Model Details
ID
meta-llama/Meta-Llama-3.1-8B-Instruct-fast
Provider
Nebius Token FactoryFamily
Release Date
Jul 23, 2024
Knowledge Cutoff
Dec 1, 2024
API Integration
NPM Package
@ai-sdk/openai-compatible
Environment Variables
NEBIUS_API_KEY
API Base URL
https://api.tokenfactory.nebius.com/v1