Question 1

What is the cost of Llama-3.1-8B-Instruct by OVHcloud AI Endpoints?

Accepted Answer

Llama-3.1-8B-Instruct by OVHcloud AI Endpoints costs $0.11 per 1M input tokens and $0.11 per 1M output tokens.

Question 2

What is the context window of Llama-3.1-8B-Instruct by OVHcloud AI Endpoints?

Accepted Answer

Llama-3.1-8B-Instruct by OVHcloud AI Endpoints has a context window of 131K tokens. It supports up to 131K input tokens and can generate up to 131K output tokens.

Question 3

What are the capabilities of Llama-3.1-8B-Instruct by OVHcloud AI Endpoints?

Accepted Answer

Llama-3.1-8B-Instruct by OVHcloud AI Endpoints supports tool calling/function calling, structured output, adjustable temperature. It has open weights.

Question 4

What input and output types does Llama-3.1-8B-Instruct support?

Accepted Answer

Llama-3.1-8B-Instruct by OVHcloud AI Endpoints accepts text as input and can generate text as output.

Question 5

Is Llama-3.1-8B-Instruct by OVHcloud AI Endpoints open source?

Accepted Answer

Yes, Llama-3.1-8B-Instruct by OVHcloud AI Endpoints has open weights, meaning the model weights are publicly available for download and self-hosting.

Question 6

Does Llama-3.1-8B-Instruct support function calling?

Accepted Answer

Yes, Llama-3.1-8B-Instruct by OVHcloud AI Endpoints supports tool calling (also known as function calling), allowing it to interact with external tools and APIs during conversations.

Llama-3.1-8B-Instruct API

Input Modalities

Output Modalities

Standard (per 1M tokens)

Llama-3.1-8B-Instruct API

Input Modalities

Output Modalities

Standard (per 1M tokens)