Mistral NeMo

Retired Jul 2026

A 12B model built by Mistral AI with NVIDIA under Apache 2.0, released July 2024, that runs on a single GPU with multilingual support.

Params: 12B
Context: 128K tokens
Max output: 33K
Released: Jul 2024
License: Apache 2.0

Visit Mistral Compare vs other LLMs →

Hosted API pricing

How we price

Order

Providers are listed cheapest input rate first, then by output rate, a tie going to the creator's own listing. A provider that lists the model without a published rate sits at the end.

Prices

Base-tier, on-demand rates in USD per 1M tokens, converted at ECB reference rates where a provider publishes in another currency. Cached-input and batch rates show only where a provider publishes them. "Cheapest" marks the one provider with the lowest input and output pair; a tie wears no badge.

Cost

Input rate times the input tokens plus output rate times the output tokens, at the monthly volume set above the table. Cached-input, batch, long-context and reasoning-token billing are not modelled.

Transparency and funding

Affiliates: Affiliate links are marked. We may earn a commission if you click them, but commissions never affect the order.

Every provider serving Mistral NeMo, cheapest input first. Set your monthly volume to see what each would bill.

Input M Output M

Every provider serving Mistral NeMo, with its price per 1M input and output tokens and what the volume above would cost
Provider	Input /1M	Output /1M	Cost at 10M in + 2M out	Link
Mistral Creator	Open weights, no hosted price			Visit website

Heads up: Base-tier, on-demand rates per 1M tokens; cached, batch and long-context tiers excluded. A provider may serve a shorter context or a quantized build than the creator's release. Verify before provisioning. More on how we price.

Estimated cost to self-host

Mistral NeMo needs about 11 GB of GPU memory at 4-bit with 32K context. The cheapest rental that fits is 1× RTX 5060 Ti at about $101 a month.

Fits on 1 Single node ≤ 8

What it costs to self-host Mistral NeMo at each precision: the memory it needs, the cheapest rental that holds it, that rental's month and the API volume it pays off at
Precision	Memory	Cheapest fit (32K context)(Full 128K context)	Cost /mo
4-bit INT4 / FP4	11 GB19 GB	1× RTX 5060 Ti	$101$202
8-bit FP8 / INT8	19 GB25 GB	1× RTX 3090	$180$202
16-bit FP16 / BF16	31 GB47 GB	2× RTX 3090	$360$403

Estimates based on median on-demand rates for Nvidia GPUs. Memory is weights plus KV cache for one request, using FP8 KV cache where supported and FP16/BF16 otherwise. No guarantee of runtime support, usable performance, or that a matching quantized build exists. Pricing methodology.

Runpod

Spin Up a GPU in Seconds - No Setup Required

Deploy AI Models Globally in 30+ Regions

Scale from 0 to 1000 GPUs on Demand

PyTorch, Tensorflow & Docker Ready

Learn more

Capabilities

What Mistral NeMo accepts and can do, as published by Mistral.

Text Accepts and generates natural-language text.

Common questions

What is Mistral NeMo good for?

Multilingual text generation on your own hardware. Apache 2.0 weights, small enough for a single consumer GPU.

When is Mistral NeMo not a good fit?

Hosted use: Mistral retired it from its own API in July 2026. Text only, with no function calling or structured output.

What is the cheapest way to run Mistral NeMo?

No provider we track hosts it; self-hosting on the cheapest rental that fits (1x RTX 5060 Ti, $0.14 per hour) costs about $101 a month.

Can I self-host Mistral NeMo?

Yes. The weights are Apache 2.0 licensed. At 4-bit it needs about 11 GB of GPU memory, which starts at roughly $101 a month on the cheapest rental that fits.