Question 1

What is the cost of Llama 3.1 70B Instruct by LLM Gateway?

Accepted Answer

Llama 3.1 70B Instruct by LLM Gateway costs $0.72 per 1M input tokens and $0.72 per 1M output tokens.

Question 2

What is the context window of Llama 3.1 70B Instruct by LLM Gateway?

Accepted Answer

Llama 3.1 70B Instruct by LLM Gateway has a context window of 128K tokens. It supports up to 128K input tokens and can generate up to 2K output tokens.

Question 3

What are the capabilities of Llama 3.1 70B Instruct by LLM Gateway?

Accepted Answer

Llama 3.1 70B Instruct by LLM Gateway supports adjustable temperature. It has open weights.

Question 4

What input and output types does Llama 3.1 70B Instruct support?

Accepted Answer

Llama 3.1 70B Instruct by LLM Gateway accepts text as input and can generate text as output.

Question 5

Is Llama 3.1 70B Instruct by LLM Gateway open source?

Accepted Answer

Yes, Llama 3.1 70B Instruct by LLM Gateway has open weights, meaning the model weights are publicly available for download and self-hosting.

Llama 3.1 70B Instruct API

Input Modalities

Output Modalities

Standard (per 1M tokens)