Meta-Llama-3.1-405B-Instruct API
About
Process massive datasets with Meta-Llama-3.1-405B-Instruct, featuring an expansive 128K context window for long-document analysis. This model delivers cost-effective pricing at $5.33/1M input and $16.00/1M output tokens, native tool calling support, open weights architecture. Access Meta-Llama-3.1-405B-Instruct via the Azure Cognitive Services API with up to 33K output tokens.
Capabilities
Input Modalities
text
Output Modalities
text
Reasoning
No
Structured Output
No
Tool Use
Yes
WeightsOpen
Limits
Context Window
128K
Tokens
Input Limit
128K
Tokens
Max Output
33K
Tokens
Pricing
Standard (per 1M tokens)
Input
$5.33
Output
$16.00
Frequently Asked Questions
Meta-Llama-3.1-405B-Instruct by Azure Cognitive Services costs $5.33 per 1M input tokens and $16.00 per 1M output tokens.
Model Details
ID
meta-llama-3.1-405b-instruct
Provider
Azure Cognitive ServicesFamily
llama
Release Date
Jul 23, 2024
Knowledge Cutoff
Dec 1, 2023
API Integration
NPM Package
@ai-sdk/azure
Environment Variables
AZURE_COGNITIVE_SERVICES_RESOURCE_NAME
AZURE_COGNITIVE_SERVICES_API_KEY