Llama 3.1 70B Instruct API
About
Process massive datasets with Llama 3.1 70B Instruct, featuring an expansive 128K context window for long-document analysis. This model delivers cost-effective pricing at $0.72/1M input and $0.72/1M output tokens, open weights architecture. Access Llama 3.1 70B Instruct via the DevPass (LLM Gateway) API with up to 2K output tokens.
Capabilities
Input Modalities
text
Output Modalities
text
Reasoning
No
Structured Output
No
Tool Use
No
WeightsOpen
Temperature
Adjustable
Attachment
Not Supported
Limits
Context Window
128K
Tokens
Input Limit
128K
Tokens
Max Output
2K
Tokens
Pricing
Standard (per 1M tokens)
Input
$0.72
Output
$0.72
Frequently Asked Questions
Llama 3.1 70B Instruct by DevPass (LLM Gateway) costs $0.72 per 1M input tokens and $0.72 per 1M output tokens.
Model Details
ID
llama-3.1-70b-instruct
Provider
DevPass (LLM Gateway)Family
llama
Release Date
Jul 23, 2024
Knowledge Cutoff
N/A
API Integration
NPM Package
@ai-sdk/openai-compatible
Environment Variables
LLMGATEWAY_API_KEY
API Base URL
https://api.llmgateway.io/v1