Llama 3 70B

Meta's 70B-parameter open-weight Llama 3 model, released April 2024.

Params: 70B
Context: 8K tokens
Cutoff: Dec 2023
Released: Apr 2024
License: Meta Llama 3 Community License

Visit Meta Compare vs other LLMs →

Hosted API price

Cheapest via Replicate · per 1M tokens

USD

Input: $0.65 /1M
Output: $2.75 /1M
Hosted by: 2 providers

Hosted API pricing

How we price

Order

Providers are listed cheapest input rate first, then by output rate, a tie going to the creator's own listing. A provider that lists the model without a published rate sits at the end.

Prices

Base-tier, on-demand rates in USD per 1M tokens, converted at ECB reference rates where a provider publishes in another currency. Cached-input and batch rates show only where a provider publishes them. "Cheapest" marks the one provider with the lowest input and output pair; a tie wears no badge.

Cost

Input rate times the input tokens plus output rate times the output tokens, at the monthly volume set above the table. Cached-input, batch, long-context and reasoning-token billing are not modelled.

Transparency and funding

Affiliates: Affiliate links are marked. We may earn a commission if you click them, but commissions never affect the order.

Every provider serving Llama 3 70B, cheapest input first. Set your monthly volume to see what each would bill.

Input M Output M

Every provider serving Llama 3 70B, with its price per 1M input and output tokens and what the volume above would cost
Provider	Input /1M	Output /1M	Cost at 10M in + 2M out	Link
Replicate	$0.65	$2.75	$12.00	Visit website
Meta Creator	Open weights, no hosted price			Visit website

Heads up: Base-tier, on-demand rates per 1M tokens; cached, batch and long-context tiers excluded. A provider may serve a shorter context or a quantized build than the creator's release. Verify before provisioning. More on how we price.

Estimated cost to self-host

Llama 3 70B needs about 43 GB of GPU memory at 4-bit with its full 8K context. The cheapest rental that fits is 4× RTX 3060 at about $230 a month.

That costs the same as roughly 230M tokens a month on Replicate's API. Self-hosting is more expensive below that volume.

Single node ≤ 8

What it costs to self-host Llama 3 70B at each precision: the memory it needs, the cheapest rental that holds it, that rental's month and the API volume it pays off at
Precision	Memory	Cheapest fit (Full 8K context)	Cost /mo	Break-even vs API
4-bit INT4 / FP4	43 GB	4× RTX 3060	$230	230M tokens /mo
8-bit FP8 / INT8	75 GB	8× RTX 3060	$461	461M tokens /mo
16-bit FP16 / BF16	145 GB	8× RTX 3090	$1,440	1B tokens /mo

Estimates based on median on-demand rates for Nvidia GPUs. Memory is weights plus KV cache for one request, using FP8 KV cache where supported and FP16/BF16 otherwise. Break-even assumes a 5:1 input-to-output ratio. No guarantee of runtime support, usable performance, or that a matching quantized build exists. Pricing methodology.

Similarly priced models

The models nearest Llama 3 70B by blended rate, each at its own cheapest provider.

Models priced nearest Llama 3 70B per 1M tokens, each at its cheapest provider
Model	Blended /1M	Input /1M	Output /1M	Context	Cutoff	vs Llama 3 70B
Qwen3.6-Plus Alibaba Cloud	$0.9167	$0.50	$3.00	1M		−8%
GLM-5.2 Z.AI	$0.95	$0.70	$2.20	1M		−5%
Nemotron 3 Ultra 550B A55B Nvidia	$0.99	$0.66	$2.64	1M	Sep 2025	−1%
DeepSeek R1 DeepSeek	$1.00	$0.70	$2.50	128K		0%
DeepSeek R1 Turbo DeepSeek	$1.00	$0.70	$2.50	64K		0%
Llama 3 70B This model Meta	$1.00	$0.65	$2.75	8K	Dec 2023
Qwen3-VL-235B-A22B Thinking Alibaba Cloud	$1.00	$0.40	$4.00	262K		0%
Kimi K2.6 Moonshot AI	$1.0333	$0.60	$3.20	262K		+3%
Grok Build 0.1 xAI	$1.1667	$1.00	$2.00	256K		+17%
Command A+ Cohere	$1.20	$0.80	$3.20	128K		+20%
GLM-5.1 Z.AI	$1.2377	$0.825	$3.301	205K		+24%

USD per 1M tokens at each model's cheapest listed provider. Blended is the cost of 10M input plus 2M output tokens, spread over the 12M.

Runpod

Spin Up a GPU in Seconds - No Setup Required

Deploy AI Models Globally in 30+ Regions

Scale from 0 to 1000 GPUs on Demand

PyTorch, Tensorflow & Docker Ready

Learn more

Capabilities

What Llama 3 70B accepts and can do, as published by Meta.

Text Accepts and generates natural-language text.

Common questions

What is Llama 3 70B good for?

Text-only generation, chat and classification on your own hardware. Open weights under the Meta Llama 3 Community License, servable on a single high-memory GPU.

When is Llama 3 70B not a good fit?

Long documents: it takes far shorter inputs than the later 70B Llamas. No image input or tool calling, and its knowledge is older than the current open models'.

What is the cheapest way to run Llama 3 70B?

Hosted, unless you push serious volume. Replicate charges $0.65 in / $2.75 out per 1M tokens. The cheapest rental that fits is 4x RTX 3060 at $230 a month, which costs the same as about 230M tokens a month on that API.

Can I self-host Llama 3 70B?

Yes. The weights are released under the Meta Llama 3 Community License. At 4-bit it needs about 43 GB of GPU memory, which starts at roughly $230 a month on the cheapest rental that fits.