NVIDIA: Llama 3.1 Nemotron 70B Instruct API
About
Process massive datasets with NVIDIA: Llama 3.1 Nemotron 70B Instruct, featuring an expansive 131K context window for long-document analysis. This model delivers cost-effective pricing at $1.20/1M input and $1.20/1M output tokens, native tool calling support. Access NVIDIA: Llama 3.1 Nemotron 70B Instruct via the Kilo Gateway API with up to 16K output tokens.
Capabilities
Input Modalities
text
Output Modalities
text
Reasoning
No
Structured Output
No
Tool Use
Yes
WeightsClosed
Limits
Context Window
131K
Tokens
Input Limit
131K
Tokens
Max Output
16K
Tokens
Pricing
Standard (per 1M tokens)
Input
$1.20
Output
$1.20
Frequently Asked Questions
NVIDIA: Llama 3.1 Nemotron 70B Instruct by Kilo Gateway costs $1.20 per 1M input tokens and $1.20 per 1M output tokens.
Model Details
ID
nvidia/llama-3.1-nemotron-70b-instruct
Provider
Kilo GatewayFamily
Release Date
Oct 12, 2024
Knowledge Cutoff
N/A
API Integration
NPM Package
@ai-sdk/openai-compatible
Environment Variables
KILO_API_KEY
API Base URL
https://api.kilo.ai/api/gateway