What is the context window of Nvidia Nemotron 70b by NanoGPT?

Nvidia Nemotron 70b by NanoGPT has a context window of 16K tokens. It supports up to 16K input tokens and can generate up to 8K output tokens.

What input and output types does Nvidia Nemotron 70b support?

Nvidia Nemotron 70b by NanoGPT accepts text as input and can generate text as output.

Is Nvidia Nemotron 70b by NanoGPT open source?

No, Nvidia Nemotron 70b by NanoGPT has closed weights. The model is only available through the NanoGPT API.

Back to Models

Nvidia Nemotron 70b API

NanoGPT

About

Nvidia Nemotron 70b is a high-performance LLM available via the NanoGPT API, ideal for scalable text generation and natural language processing. This model delivers cost-effective pricing at $0.36/1M input and $0.41/1M output tokens. Access Nvidia Nemotron 70b via the NanoGPT API with up to 8K output tokens.

Capabilities

Input Modalities

text

Output Modalities

text

Reasoning

Structured Output

Tool Use

WeightsClosed

Temperature

Fixed

Attachment

Not Supported

Limits

Context Window

16K

Tokens

Input Limit

16K

Tokens

Max Output

Tokens

Pricing

Standard (per 1M tokens)

Input

$0.36

Output

$0.41

Frequently Asked Questions

Nvidia Nemotron 70b by NanoGPT costs $0.36 per 1M input tokens and $0.41 per 1M output tokens.

Model Details

nvidia/Llama-3.1-Nemotron-70B-Instruct-HF

Provider

NanoGPT

Family

nemotron

Release Date

Apr 15, 2025

Knowledge Cutoff

N/A

API Integration

NPM Package

@ai-sdk/openai-compatible

Environment Variables

NANO_GPT_API_KEY

API Base URL

https://nano-gpt.com/api/v1

Documentation