Nemotron 3.5 Bolt 74B A9B

A 74B hybrid Mamba-2 and MoE vision-language model (9B active) that NVIDIA compressed from Nemotron 3.5 Super VL to run everyday agent tasks locally, under OpenMDW 1.1.

Params: 74B, 9B active
Context: 262K tokens
Released: Oct 2026
License: OpenMDW 1.1

Visit Nvidia Compare vs other LLMs →

Hosted API pricing

How we price

Order

Providers are listed cheapest input rate first, then by output rate, a tie going to the creator's own listing. A provider that lists the model without a published rate sits at the end.

Prices

Base-tier, on-demand rates in USD per 1M tokens, converted at ECB reference rates where a provider publishes in another currency. Cached-input and batch rates show only where a provider publishes them. "Cheapest" marks the one provider with the lowest input and output pair; a tie wears no badge.

Cost

Input rate times the input tokens plus output rate times the output tokens, at the monthly volume set above the table. Cached-input, batch, long-context and reasoning-token billing are not modelled.

Transparency and funding

Affiliates: Affiliate links are marked. We may earn a commission if you click them, but commissions never affect the order.

Every provider serving Nemotron 3.5 Bolt 74B A9B, cheapest input first. Set your monthly volume to see what each would bill.

Input M Output M

Every provider serving Nemotron 3.5 Bolt 74B A9B, with its price per 1M input and output tokens and what the volume above would cost
Provider	Input /1M	Output /1M	Cost at 10M in + 2M out	Link
Nvidia Creator	Open weights, no hosted price			Visit website

Heads up: Base-tier, on-demand rates per 1M tokens; cached, batch and long-context tiers excluded. A provider may serve a shorter context or a quantized build than the creator's release. Verify before provisioning. More on how we price.

Estimated cost to self-host

Nemotron 3.5 Bolt 74B A9B needs about 43 GB of GPU memory at 4-bit with 32K context. The cheapest rental that fits is 2× RTX 3090 at about $331 a month.

Single node ≤ 8

What it costs to self-host Nemotron 3.5 Bolt 74B A9B at each precision: the memory it needs, the cheapest rental that holds it, that rental's month and the API volume it pays off at
Precision	Memory	Cheapest fit (32K context)(Full 262K context)	Cost /mo
4-bit INT4 / FP4	43 GB44 GB	2× RTX 3090	$331$403
8-bit FP8 / INT8	76 GB78 GB	4× RTX 3090	$662$662
16-bit FP16 / BF16	150 GB152 GB	8× RTX 3090	$1,325$1,325

Estimates based on median on-demand rates for Nvidia GPUs. Memory is weights plus KV cache for one request, using FP8 KV cache where supported and FP16/BF16 otherwise. No guarantee of runtime support, usable performance, or that a matching quantized build exists. Pricing methodology.

Runpod

Spin Up a GPU in Seconds - No Setup Required

Deploy AI Models Globally in 30+ Regions

Scale from 0 to 1000 GPUs on Demand

PyTorch, Tensorflow & Docker Ready

Learn more

Capabilities

What Nemotron 3.5 Bolt 74B A9B accepts and can do, as published by Nvidia.

Text Accepts and generates natural-language text.
Image Accepts images as input alongside text.
Video Accepts video as input.
Reasoning Thinks before it answers, always on or as a switchable mode.
Function calling Connect to external tools, APIs, and systems.
Structured output Return responses in structured formats like JSON.

Common questions

What is Nemotron 3.5 Bolt 74B A9B good for?

Everyday agent tasks on local hardware, with images and video as input. NVIDIA ships a native 2-bit build sized for a single consumer GPU, under the OpenMDW 1.1 license, and the full-precision weights for fine-tuning.

When is Nemotron 3.5 Bolt 74B A9B not a good fit?

Audio input: it takes text, images and video and returns text only. The full-precision weights are meant for fine-tuning and take far more memory than the 2-bit local build, and no maximum output or knowledge cutoff is published.

What is the cheapest way to run Nemotron 3.5 Bolt 74B A9B?

No provider we track hosts it; self-hosting on the cheapest rental that fits (2x RTX 3090, $0.46 per hour) costs about $331 a month.

Can I self-host Nemotron 3.5 Bolt 74B A9B?

Yes. The weights are OpenMDW 1.1 licensed. At 4-bit it needs about 43 GB of GPU memory, which starts at roughly $331 a month on the cheapest rental that fits.