Question 1

What is the cost of Llama 3.1 70B Instruct by Vercel AI Gateway?

Accepted Answer

Llama 3.1 70B Instruct by Vercel AI Gateway costs $0.40 per 1M input tokens and $0.40 per 1M output tokens.

Question 2

What is the context window of Llama 3.1 70B Instruct by Vercel AI Gateway?

Accepted Answer

Llama 3.1 70B Instruct by Vercel AI Gateway has a context window of 131K tokens. It supports up to 131K input tokens and can generate up to 16K output tokens.

Question 3

What are the capabilities of Llama 3.1 70B Instruct by Vercel AI Gateway?

Accepted Answer

Llama 3.1 70B Instruct by Vercel AI Gateway supports tool calling/function calling, adjustable temperature. It has closed weights.

Question 4

What input and output types does Llama 3.1 70B Instruct support?

Accepted Answer

Llama 3.1 70B Instruct by Vercel AI Gateway accepts text as input and can generate text as output.

Question 5

Is Llama 3.1 70B Instruct by Vercel AI Gateway open source?

Accepted Answer

No, Llama 3.1 70B Instruct by Vercel AI Gateway has closed weights. The model is only available through the Vercel AI Gateway API.

Question 6

Does Llama 3.1 70B Instruct support function calling?

Accepted Answer

Yes, Llama 3.1 70B Instruct by Vercel AI Gateway supports tool calling (also known as function calling), allowing it to interact with external tools and APIs during conversations.

Question 7

What is the knowledge cutoff date for Llama 3.1 70B Instruct?

Accepted Answer

Llama 3.1 70B Instruct by Vercel AI Gateway has a knowledge cutoff date of 2023-12. This means the model was trained on data available up until that date.

Llama 3.1 70B Instruct API

Input Modalities

Output Modalities

Standard (per 1M tokens)

Llama 3.1 70B Instruct API

Input Modalities

Output Modalities

Standard (per 1M tokens)