Nemotron 3 Super 120B A12B
A 120B LatentMoE hybrid from NVIDIA activating 12B per token, combining Mamba-2, MoE and attention layers with Multi-Token Prediction, under the NVIDIA Nemotron Open Model License.
Key Specifications
- Context window
- 1M tokens
- Knowledge cutoff
- Released
- Parameters
- 120B, 12B active
- Inputs
- Text
- Capabilities Show details
- Reasoning Thinks before it answers, always on or as a switchable mode. Function calling Connect to external tools, APIs, and systems. Structured output Return responses in structured formats like JSON.
Hosted API pricing
| Provider | Input / 1M tokens | Output / 1M tokens | Cached input / 1M | Cost at 10M in + 2M out | |
|---|---|---|---|---|---|
|
|
$0.09 | $0.50 | $1.90 | View | |
|
|
$0.30 | $0.65 | $0.06 | $4.30 | View |
|
|
$0.50 | $1.50 | $8.00 | View | |
|
|
Open weights, no hosted price | View | |||
Heads up: Base-tier, on-demand rates per 1M tokens; cached, batch and long-context tiers excluded. A provider may serve a shorter context or a quantized build than the creator's release. Verify before provisioning. More on how we price.
Estimated cost to self-host
Nemotron 3 Super 120B A12B needs about 68 GB of GPU memory at 4-bit with 32K context. The cheapest rental that fits is 8× RTX 3060 at about $288 a month.
That costs the same as roughly 2B tokens a month on Geodd's API. Self-hosting is more expensive below that volume.
| Precision | Cheapest, 32K context | Cheapest, full 1M context |
|---|---|---|
| 4-bitINT4 / FP4 |
|
|
| 8-bitFP8 / INT8 |
|
|
| 16-bitFP16 / BF16 |
|
|
Estimates based on median on-demand rates for Nvidia GPUs. Memory is weights plus KV cache for one request, using FP8 KV cache where supported and FP16/BF16 otherwise. Break-even assumes a 5:1 input-to-output ratio. No guarantee of runtime support, usable performance, or that a matching quantized build exists. How we estimate costs.
Similarly priced models
The models nearest Nemotron 3 Super 120B A12B by blended rate, each at its own cheapest provider.
| Model | Blended / 1M | Input / 1M | Output / 1M | Context | Cutoff | vs Nemotron 3 Super 120B A12B |
|---|---|---|---|---|---|---|
|
|
$0.15 | $0.10 | $0.40 | 1M | Jan 2025 | −5% |
|
|
$0.15 | $0.10 | $0.40 | 1M | Jun 2024 | −5% |
|
|
$0.15 | $0.15 | $0.15 | 256K | −5% | |
|
|
$0.15 | $0.10 | $0.40 | 1M | −5% | |
|
|
$0.155 | $0.05 | $0.68 | 128K | Dec 2023 | −2% |
|
|
$0.1583 | $0.09 | $0.50 | 1M | Jun 2025 | |
|
|
$0.17 | $0.13 | $0.37 | 256K | Jan 2025 | +7% |
|
|
$0.1717 | $0.09 | $0.58 | 262K | +8% | |
|
|
$0.175 | $0.13 | $0.40 | 128K | Dec 2023 | +11% |
|
|
$0.1967 | $0.13 | $0.53 | 262K | +24% | |
|
|
$0.20 | $0.20 | $0.20 | 256K | +26% |
Prices are USD per 1M tokens at each model's cheapest listed provider. Blended is the cost of 10M input plus 2M output tokens, spread over the 12M.
Frequently Asked Questions
What is Nemotron 3 Super 120B A12B good for?
Agent and high-volume work such as IT ticket automation. Open weights under the NVIDIA Nemotron Open Model License, servable on a single high-memory GPU.
When is Nemotron 3 Super 120B A12B not a good fit?
Image input: it is text only. Memory follows the full 120B parameters, not the 12B active, and no maximum output is published.
What is the cheapest way to run Nemotron 3 Super 120B A12B?
Hosted, unless you push serious volume. Geodd charges $0.09 in / $0.50 out per 1M tokens. The cheapest rental that fits is 8x RTX 3060 at $288 a month, which costs the same as about 2B tokens a month on that API.
Can I self-host Nemotron 3 Super 120B A12B?
Yes. The weights are released under the NVIDIA Nemotron Open Model License. At 4-bit it needs about 68 GB of GPU memory, which starts at roughly $288 a month on the cheapest rental that fits.
More from Nvidia
| Model | Context | Input / 1M | Output / 1M |
|---|---|---|---|
|
|
262K | $0.05 | $0.20 |
|
|
1M | $0.66 | $2.64 |