Meta: Llama 3.1 70B Instruct

meta-llama/llama-3.1-70b-instruct

Released Jul 23, 2024131,072 context

$0.40/M input tokens$0.40/M output tokens

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases.

It has demonstrated strong performance compared to leading closed-source models in human evaluations.

To read more about the model release, click here. Usage of this model is subject to Meta's Acceptable Use Policy.

Providers for Llama 3.1 70B Instruct

OpenRouter routes requests to the best providers that are able to handle your prompt size and parameters, with fallbacks to maximize uptime.

Performance for Llama 3.1 70B Instruct

Compare different providers across OpenRouter

Effective Pricing for Llama 3.1 70B Instruct

Actual cost per million tokens across providers over the past hour

Apps using Llama 3.1 70B Instruct

Top public apps this month

Recent activity on Llama 3.1 70B Instruct

Total usage per day on OpenRouter

Prompt

900M

Completion

43.6M

Prompt tokens measure input size. Reasoning tokens show internal thinking before a response. Completion tokens reflect total output length.

Uptime stats for Llama 3.1 70B Instruct

Uptime stats for Llama 3.1 70B Instruct across all providers

Sample code and API for Llama 3.1 70B Instruct

OpenRouter normalizes requests and responses across providers for you.

OpenRouter provides an OpenAI-compatible completion API to 300+ models & providers that you can call directly, or using the OpenAI SDK. Additionally, some third-party SDKs are available.

In the examples below, the OpenRouter-specific headers are optional. Setting them allows your app to appear on the OpenRouter leaderboards.

Using third-party SDKs

For information about using third-party SDKs and frameworks with OpenRouter, please see our frameworks documentation.

See the Request docs for all possible fields, and Parameters for explanations of specific sampling parameters.

Llama 3.1 70B Instruct - API Pricing & Providers | OpenRouter