Qwen3-32B FP8

FP8-quantized version of the 32B dense Qwen3 model, with switching between reasoning and general dialogue modes.

Params: 32.8B
Context: 33K tokens
License: Apache 2.0

Visit Alibaba Cloud Compare vs other LLMs →

Hosted API pricing

How we price

Order

Providers are listed cheapest input rate first, then by output rate, a tie going to the creator's own listing. A provider that lists the model without a published rate sits at the end.

Prices

Base-tier, on-demand rates in USD per 1M tokens, converted at ECB reference rates where a provider publishes in another currency. Cached-input and batch rates show only where a provider publishes them. "Cheapest" marks the one provider with the lowest input and output pair; a tie wears no badge.

Cost

Input rate times the input tokens plus output rate times the output tokens, at the monthly volume set above the table. Cached-input, batch, long-context and reasoning-token billing are not modelled.

Transparency and funding

Affiliates: Affiliate links are marked. We may earn a commission if you click them, but commissions never affect the order.

Every provider serving Qwen3-32B FP8, cheapest input first. Set your monthly volume to see what each would bill.

Input M Output M

Every provider serving Qwen3-32B FP8, with its price per 1M input and output tokens and what the volume above would cost
Provider	Input /1M	Output /1M	Cost at 10M in + 2M out	Link
Alibaba Cloud Creator	Open weights, no hosted price			Visit website

Heads up: Base-tier, on-demand rates per 1M tokens; cached, batch and long-context tiers excluded. A provider may serve a shorter context or a quantized build than the creator's release. Verify before provisioning. More on how we price.

Estimated cost to self-host

Qwen3-32B FP8 needs about 24 GB of GPU memory at 4-bit with its full 32K context. The cheapest rental that fits is 2× RTX 5060 Ti at about $202 a month.

Single node ≤ 8

What it costs to self-host Qwen3-32B FP8 at each precision: the memory it needs, the cheapest rental that holds it, that rental's month and the API volume it pays off at
Precision	Memory	Cheapest fit (Full 32K context)	Cost /mo
4-bit INT4 / FP4	24 GB	2× RTX 5060 Ti	$202
8-bit FP8 / INT8	39 GB	4× RTX 5060 Ti	$403
16-bit FP16 / BF16	76 GB	4× RTX 3090	$720

Estimates based on median on-demand rates for Nvidia GPUs. Memory is weights plus KV cache for one request, using FP8 KV cache where supported and FP16/BF16 otherwise. No guarantee of runtime support, usable performance, or that a matching quantized build exists. Pricing methodology.

Lium

Built for agents: CLI, SDK and MCP server. Your agent rents and runs GPUs itself.

A permissionless marketplace. 1000+ nodes from independent providers worldwide.

Hard to find nodes available; B200 and B300 Blackwell nodes listed now.

Consumer + DC grade cards for cheap. H100s from $1/hr, RTX 5090s from $0.35/hr.

View Pricing

Capabilities

What Qwen3-32B FP8 accepts and can do, as published by Alibaba Cloud.

Text Accepts and generates natural-language text.
Reasoning Thinks before it answers, always on or as a switchable mode.
Function calling Connect to external tools, APIs, and systems.
Structured output Return responses in structured formats like JSON.

Common questions

What is Qwen3-32B FP8 good for?

Self-hosted reasoning and chat with a switch between thinking and non-thinking modes, covering over 100 languages, Alibaba says. Apache 2.0 weights, on a single high-memory GPU.

When is Qwen3-32B FP8 not a good fit?

Image, video or audio input: text only, with a short native context. It runs all 32B parameters on every token, unlike the 30B-A3B mixture of experts with 3B active, so each token takes more compute to serve.

What is the cheapest way to run Qwen3-32B FP8?

No provider we track hosts it; self-hosting on the cheapest rental that fits (2x RTX 5060 Ti, $0.28 per hour) costs about $202 a month.

Can I self-host Qwen3-32B FP8?

Yes. The weights are Apache 2.0 licensed. At 4-bit it needs about 24 GB of GPU memory, which starts at roughly $202 a month on the cheapest rental that fits.