@cf/meta/llama-2-7b-chat-int8 API
About
@cf/meta/llama-2-7b-chat-int8 is a high-performance LLM available via the Cloudflare Workers AI API, ideal for scalable text generation and natural language processing. This model delivers cost-effective pricing at $0.56/1M input and $6.67/1M output tokens, native tool calling support, open weights architecture. Access @cf/meta/llama-2-7b-chat-int8 via the Cloudflare Workers AI API with up to 8K output tokens.
Capabilities
Input Modalities
text
Output Modalities
text
Reasoning
No
Structured Output
No
Tool Use
Yes
WeightsOpen
Temperature
Adjustable
Attachment
Not Supported
Limits
Context Window
8K
Tokens
Input Limit
8K
Tokens
Max Output
8K
Tokens
Pricing
Standard (per 1M tokens)
Input
$0.56
Output
$6.67
Frequently Asked Questions
@cf/meta/llama-2-7b-chat-int8 by Cloudflare Workers AI costs $0.56 per 1M input tokens and $6.67 per 1M output tokens.
Model Details
ID
llama-2-7b-chat-int8
Provider
Cloudflare Workers AIFamily
llama
Release Date
Sep 25, 2023
Knowledge Cutoff
N/A
API Integration
NPM Package
@ai-sdk/openai-compatible
Environment Variables
CLOUDFLARE_ACCOUNT_ID
CLOUDFLARE_API_KEY
API Base URL
https://api.cloudflare.com/client/v4/accounts/${CLOUDFLARE_ACCOUNT_ID}/ai/v1