AI Model APIs
AI Model APIsProviders
AI Model APIs

The complete platform for comparing AI models. Find pricing, capabilities, and the perfect model for your use case.

contact@aimodelapis.com

Resources

  • AI Models APIs
  • Providers

About

  • About
  • Contact
  • Privacy Policy
  • Terms of Service

© 2026 AI Model APIs. All rights reserved.

Back to Models
Nvidia

Llama 3.1 405b Instruct API

Nvidia
About

Process massive datasets with Llama 3.1 405b Instruct, featuring an expansive 128K context window for long-document analysis. This model delivers available completely free of charge, native tool calling support, open weights architecture. Access Llama 3.1 405b Instruct via the Nvidia API with up to 4K output tokens.

Capabilities

Input Modalities

text

Output Modalities

text
Reasoning
No
Structured Output
Yes
Tool Use
Yes
WeightsOpen
Temperature
Adjustable
Attachment
Not Supported
Limits
Context Window
128K

Tokens

Input Limit
128K

Tokens

Max Output
4K

Tokens

Pricing

Standard (per 1M tokens)

Input
Free
Output
Free
Frequently Asked Questions

Llama 3.1 405b Instruct by Nvidia costs Free per 1M input tokens and Free per 1M output tokens.

Model Details
ID
meta/llama-3.1-405b-instruct
Provider
Nvidia
Family
Release Date
Jul 16, 2024
Knowledge Cutoff
N/A
API Integration
NPM Package
@ai-sdk/openai-compatible
Environment Variables
NVIDIA_API_KEY
API Base URL
https://integrate.api.nvidia.com/v1
Documentation