What is Command R 08-2024 good for?

RAG and tool-use pipelines in 23 languages, at the lower-cost end of Cohere's range. CC-BY-NC weights fit a single high-memory GPU for non-commercial use.

When is Command R 08-2024 not a good fit?

Image input: it is text only. Its short maximum output limits long answers, commercial self-hosting needs a separate licence from Cohere, and the newer Command models know more recent events.

What is the cheapest way to run Command R 08-2024?

Hosted, unless you push serious volume. Cohere charges $0.15 in / $0.60 out per 1M tokens. The cheapest rental that fits is 2x RTX 4060 Ti at $158 a month, which costs the same as about 704M tokens a month on that API.

Can I self-host Command R 08-2024?

Yes. The weights are CC-BY-NC licensed. At 4-bit it needs about 22 GB of GPU memory, which starts at roughly $158 a month on the cheapest rental that fits.

Open weights · CC-BY-NC

Command R 08-2024

Cohere's mid-range model, refreshed August 2024 and designed for RAG and tool use across 23 languages, sitting below Command A in the lineup.

Jump to: Specs Pricing Self-hosting Similar models FAQ More from Cohere

Visit website Compare vs other LLMs →

List price via Cohere

Input: $0.15 /1M tokens
Output: $0.60 /1M tokens

1 provider

Key Specifications

Context window: 128K tokens
Max output: 4K tokens
Knowledge cutoff: Jun 2024
Released: Aug 2024
Parameters: 32B
Inputs: Text

Capabilities Show details: Function calling Connect to external tools, APIs, and systems. Structured output Return responses in structured formats like JSON.

Hosted API pricing

Input tokens M Output tokens M

Provider	Input /1M tokens	Output /1M tokens	Cost at 10M in + 2M out
Cohere Creator	$0.15	$0.60	$2.70	View

Heads up: Base-tier, on-demand rates per 1M tokens; cached, batch and long-context tiers excluded. A provider may serve a shorter context or a quantized build than the creator's release. Verify before provisioning. More on how we price.

Estimated cost to self-host

Command R 08-2024 needs about 22 GB of GPU memory at 4-bit with 32K context. The cheapest rental that fits is 2× RTX 4060 Ti at about $158 a month.

That costs the same as roughly 704M tokens a month on Cohere's API. Self-hosting is more expensive below that volume.

Single node ≤ 8

Precision	Memory	Cheapest fit (32K context)(Full 128K context)	Cost /mo	Break-even vs API
4-bitINT4 / FP4	22 GB41 GB	2× RTX 4060 Ti	$158$173	704M tokens /mo768M tokens /mo
8-bitFP8 / INT8	39 GB45 GB	4× RTX 3060	$173$317	768M tokens /mo1B tokens /mo
16-bitFP16 / BF16	71 GB87 GB	8× RTX 3060	$346$634	2B tokens /mo3B tokens /mo

Estimates based on median on-demand rates for Nvidia GPUs. Memory is weights plus KV cache for one request, using FP8 KV cache where supported and FP16/BF16 otherwise. Break-even assumes a 5:1 input-to-output ratio. No guarantee of runtime support, usable performance, or that a matching quantized build exists. How we estimate costs.

Similarly priced models

The models nearest Command R 08-2024 by blended rate, each at its own cheapest provider.

Model	Blended /1M	Input /1M	Output /1M	Context	Cutoff	vs Command R 08-2024
Hy3 Tencent	$0.1967	$0.13	$0.53	262K		−13%
Ministral 3 14B Mistral	$0.20	$0.20	$0.20	256K		−11%
Qwen3.8-Flash Alibaba Cloud	$0.2033	$0.15	$0.47	1M		−10%
Qwen3-VL-8B Alibaba Cloud	$0.2083	$0.15	$0.50	262K		−7%
Qwen-MT-Turbo Alibaba Cloud	$0.215	$0.16	$0.49	16K		−4%
Command R 08-2024 This model Cohere	$0.225	$0.15	$0.60	128K	Jun 2024
GPT-4o Mini OpenAI	$0.225	$0.15	$0.60	128K	Oct 2023	0%
MiniMax-M2.7 MiniMax	$0.225	$0.15	$0.60	205K		0%
Mistral Small 4 Mistral	$0.225	$0.15	$0.60	256K		0%
Qwen3.8-27B Alibaba Cloud	$0.225	$0.17	$0.50	262K		0%
Qwen3-Coder-Next Alibaba Cloud	$0.23	$0.08	$0.98	262K		+2%

Prices are USD per 1M tokens at each model's cheapest listed provider. Blended is the cost of 10M input plus 2M output tokens, spread over the 12M.

Lium

Built for agents: CLI, SDK and MCP server. Your agent rents and runs GPUs itself.

A permissionless marketplace. 1000+ nodes from independent providers worldwide.

Hard to find nodes available; B200 and B300 Blackwell nodes listed now.

Consumer + DC grade cards for cheap. H100s from $1/hr, RTX 5090s from $0.35/hr.

View Pricing

Frequently Asked Questions

What is Command R 08-2024 good for?: RAG and tool-use pipelines in 23 languages, at the lower-cost end of Cohere's range. CC-BY-NC weights fit a single high-memory GPU for non-commercial use.
When is Command R 08-2024 not a good fit?: Image input: it is text only. Its short maximum output limits long answers, commercial self-hosting needs a separate licence from Cohere, and the newer Command models know more recent events.
What is the cheapest way to run Command R 08-2024?: Hosted, unless you push serious volume. Cohere charges $0.15 in / $0.60 out per 1M tokens. The cheapest rental that fits is 2x RTX 4060 Ti at $158 a month, which costs the same as about 704M tokens a month on that API.
Can I self-host Command R 08-2024?: Yes. The weights are CC-BY-NC licensed. At 4-bit it needs about 22 GB of GPU memory, which starts at roughly $158 a month on the cheapest rental that fits.

More from Cohere

Model	Context	Cutoff	Input /1M	Output /1M
Command R7B Open weights	128K		$0.04	$0.15
Command A+ Open weights	128K		$0.80	$3.20
Command R+ 08-2024 Open weights	128K	Feb 2023	$2.50	$10.00
Command A Open weights	256K		$2.50	$10.00
Command A Reasoning Open weights	256K	Jun 2024	No hosted price
Command A Vision Open weights	128K	Jun 2024	No hosted price
Command A Translate Open weights	8K	Jun 2024	No hosted price