Question 1

What is the cost of Llama 3.1 8B Instant by Groq?

Accepted Answer

Llama 3.1 8B Instant by Groq costs $0.05 per 1M input tokens and $0.08 per 1M output tokens.

Question 2

What is the context window of Llama 3.1 8B Instant by Groq?

Accepted Answer

Llama 3.1 8B Instant by Groq has a context window of 131K tokens. It supports up to 131K input tokens and can generate up to 131K output tokens.

Question 3

What are the capabilities of Llama 3.1 8B Instant by Groq?

Accepted Answer

Llama 3.1 8B Instant by Groq supports tool calling/function calling, adjustable temperature. It has open weights.

Question 4

What input and output types does Llama 3.1 8B Instant support?

Accepted Answer

Llama 3.1 8B Instant by Groq accepts text as input and can generate text as output.

Question 5

Is Llama 3.1 8B Instant by Groq open source?

Accepted Answer

Yes, Llama 3.1 8B Instant by Groq has open weights, meaning the model weights are publicly available for download and self-hosting.

Question 6

Does Llama 3.1 8B Instant support function calling?

Accepted Answer

Yes, Llama 3.1 8B Instant by Groq supports tool calling (also known as function calling), allowing it to interact with external tools and APIs during conversations.

Question 7

What is the knowledge cutoff date for Llama 3.1 8B Instant?

Accepted Answer

Llama 3.1 8B Instant by Groq has a knowledge cutoff date of 2023-12. This means the model was trained on data available up until that date.

Llama 3.1 8B Instant API

Input Modalities

Output Modalities

Standard (per 1M tokens)

Llama 3.1 8B Instant API

Input Modalities

Output Modalities

Standard (per 1M tokens)