What is the context window of Llama 3.1 8b Instruct by NanoGPT?

Llama 3.1 8b Instruct by NanoGPT has a context window of 131K tokens. It supports up to 131K input tokens and can generate up to 16K output tokens.

What input and output types does Llama 3.1 8b Instruct support?

Llama 3.1 8b Instruct by NanoGPT accepts text as input and can generate text as output.

Is Llama 3.1 8b Instruct by NanoGPT open source?

No, Llama 3.1 8b Instruct by NanoGPT has closed weights. The model is only available through the NanoGPT API.

Back to Models

Llama 3.1 8b Instruct API

NanoGPT

About

Process massive datasets with Llama 3.1 8b Instruct, featuring an expansive 131K context window for long-document analysis. This model delivers cost-effective pricing at $0.05/1M input and $0.05/1M output tokens. Access Llama 3.1 8b Instruct via the NanoGPT API with up to 16K output tokens.

Capabilities

Input Modalities

text

Output Modalities

text

Reasoning

Structured Output

Tool Use

WeightsClosed

Temperature

Fixed

Attachment

Not Supported

Limits

Context Window

131K

Tokens

Input Limit

131K

Tokens

Max Output

16K

Tokens

Pricing

Standard (per 1M tokens)

Input

$0.05

Output

$0.05

Frequently Asked Questions

Llama 3.1 8b Instruct by NanoGPT costs $0.05 per 1M input tokens and $0.05 per 1M output tokens.

Model Details

meta-llama/llama-3.1-8b-instruct

Provider

NanoGPT

Family

llama

Release Date

Jul 23, 2024

Knowledge Cutoff

N/A

API Integration

NPM Package

@ai-sdk/openai-compatible

Environment Variables

NANO_GPT_API_KEY

API Base URL

https://nano-gpt.com/api/v1

Documentation