Question 1

What is the cost of Llama 3.1 8B Turbo by Deep Infra?

Accepted Answer

Llama 3.1 8B Turbo by Deep Infra costs $0.02 per 1M input tokens and $0.03 per 1M output tokens.

Question 2

What is the context window of Llama 3.1 8B Turbo by Deep Infra?

Accepted Answer

Llama 3.1 8B Turbo by Deep Infra has a context window of 131K tokens. It supports up to 131K input tokens and can generate up to 16K output tokens.

Question 3

What are the capabilities of Llama 3.1 8B Turbo by Deep Infra?

Accepted Answer

Llama 3.1 8B Turbo by Deep Infra supports tool calling/function calling. It has open weights.

Question 4

What input and output types does Llama 3.1 8B Turbo support?

Accepted Answer

Llama 3.1 8B Turbo by Deep Infra accepts text as input and can generate text as output.

Question 5

Is Llama 3.1 8B Turbo by Deep Infra open source?

Accepted Answer

Yes, Llama 3.1 8B Turbo by Deep Infra has open weights, meaning the model weights are publicly available for download and self-hosting.

Question 6

Does Llama 3.1 8B Turbo support function calling?

Accepted Answer

Yes, Llama 3.1 8B Turbo by Deep Infra supports tool calling (also known as function calling), allowing it to interact with external tools and APIs during conversations.

Llama 3.1 8B Turbo API

Input Modalities

Output Modalities

Standard (per 1M tokens)