Question 1

What is the cost of Llama 3 70B Instruct by LLM Gateway?

Accepted Answer

Llama 3 70B Instruct by LLM Gateway costs $0.51 per 1M input tokens and $0.74 per 1M output tokens.

Question 2

What is the context window of Llama 3 70B Instruct by LLM Gateway?

Accepted Answer

Llama 3 70B Instruct by LLM Gateway has a context window of 8K tokens. It supports up to 8K input tokens and can generate up to 8K output tokens.

Question 3

What are the capabilities of Llama 3 70B Instruct by LLM Gateway?

Accepted Answer

Llama 3 70B Instruct by LLM Gateway supports structured output, adjustable temperature. It has open weights.

Question 4

What input and output types does Llama 3 70B Instruct support?

Accepted Answer

Llama 3 70B Instruct by LLM Gateway accepts text as input and can generate text as output.

Question 5

Is Llama 3 70B Instruct by LLM Gateway open source?

Accepted Answer

Yes, Llama 3 70B Instruct by LLM Gateway has open weights, meaning the model weights are publicly available for download and self-hosting.

Llama 3 70B Instruct API