Llama 3.1 8B Instruct AWQ API
About
Process massive datasets with Llama 3.1 8B Instruct AWQ, featuring an expansive 128K context window for long-document analysis. This model delivers cost-effective pricing at $0.12/1M input and $0.27/1M output tokens. Access Llama 3.1 8B Instruct AWQ via the Cloudflare AI Gateway API with up to 16K output tokens.
Capabilities
Input Modalities
text
Output Modalities
text
Reasoning
No
Structured Output
No
Tool Use
No
WeightsClosed
Limits
Context Window
128K
Tokens
Input Limit
128K
Tokens
Max Output
16K
Tokens
Pricing
Standard (per 1M tokens)
Input
$0.12
Output
$0.27
Frequently Asked Questions
Llama 3.1 8B Instruct AWQ by Cloudflare AI Gateway costs $0.12 per 1M input tokens and $0.27 per 1M output tokens.
Model Details
ID
workers-ai/@cf/meta/llama-3.1-8b-instruct-awq
Provider
Cloudflare AI GatewayFamily
llama
Release Date
Apr 3, 2025
Knowledge Cutoff
N/A
API Integration
NPM Package
ai-gateway-provider
Environment Variables
CLOUDFLARE_API_TOKEN
CLOUDFLARE_ACCOUNT_ID
CLOUDFLARE_GATEWAY_ID
API Base URL
https://gateway.ai.cloudflare.com/v1/${CLOUDFLARE_ACCOUNT_ID}/${CLOUDFLARE_GATEWAY_ID}/compat/