Llama 3 70B Instruct (NovitaAI) API
About
Llama 3 70B Instruct (NovitaAI) is a high-performance LLM available via the LLM Gateway API, ideal for scalable text generation and natural language processing. This model delivers cost-effective pricing at $0.51/1M input and $0.74/1M output tokens. Access Llama 3 70B Instruct (NovitaAI) via the LLM Gateway API with up to 8K output tokens.
Capabilities
Input Modalities
text
Output Modalities
text
Reasoning
No
Structured Output
No
Tool Use
No
WeightsClosed
Limits
Context Window
8K
Tokens
Input Limit
8K
Tokens
Max Output
8K
Tokens
Pricing
Standard (per 1M tokens)
Input
$0.51
Output
$0.74
Frequently Asked Questions
Llama 3 70B Instruct (NovitaAI) by LLM Gateway costs $0.51 per 1M input tokens and $0.74 per 1M output tokens.
Model Details
ID
novita/llama-3-70b-instruct
Provider
LLM GatewayFamily
llama
Release Date
Apr 18, 2024
Knowledge Cutoff
N/A
API Integration
NPM Package
@ai-sdk/openai-compatible
Environment Variables
LLMGATEWAY_API_KEY
API Base URL
https://api.llmgateway.io/v1