Qwen3-4B FP8

FP8-quantized version of Qwen3-4B, the smallest Qwen3 dense model, suited to edge deployment with a hybrid thinking mode.

Params: 4B
Context: 33K tokens
License: Apache 2.0

Visit Alibaba Cloud Compare vs other LLMs →

Hosted API pricing

How we price

Order

Providers are listed cheapest input rate first, then by output rate, a tie going to the creator's own listing. A provider that lists the model without a published rate sits at the end.

Prices

Base-tier, on-demand rates in USD per 1M tokens, converted at ECB reference rates where a provider publishes in another currency. Cached-input and batch rates show only where a provider publishes them. "Cheapest" marks the one provider with the lowest input and output pair; a tie wears no badge.

Cost

Input rate times the input tokens plus output rate times the output tokens, at the monthly volume set above the table. Cached-input, batch, long-context and reasoning-token billing are not modelled.

Transparency and funding

Affiliates: Affiliate links are marked. We may earn a commission if you click them, but commissions never affect the order.

Every provider serving Qwen3-4B FP8, cheapest input first. Set your monthly volume to see what each would bill.

Input M Output M

Every provider serving Qwen3-4B FP8, with its price per 1M input and output tokens and what the volume above would cost
Provider	Input /1M	Output /1M	Cost at 10M in + 2M out	Link
Alibaba Cloud Creator	Open weights, no hosted price			Visit website

Heads up: Base-tier, on-demand rates per 1M tokens; cached, batch and long-context tiers excluded. A provider may serve a shorter context or a quantized build than the creator's release. Verify before provisioning. More on how we price.

Estimated cost to self-host

Qwen3-4B FP8 needs about 9 GB of GPU memory at 4-bit with its full 32K context. The cheapest rental that fits is 1× RTX 3060 at about $58 a month.

Fits on 1 Single node ≤ 8

What it costs to self-host Qwen3-4B FP8 at each precision: the memory it needs, the cheapest rental that holds it, that rental's month and the API volume it pays off at
Precision	Memory	Cheapest fit (Full 32K context)	Cost /mo
4-bit INT4 / FP4	9 GB	1× RTX 3060	$58
8-bit FP8 / INT8	8 GB	1× RTX 4060 Ti	$94
16-bit FP16 / BF16	15 GB	2× RTX 3060	$115

Estimates based on median on-demand rates for Nvidia GPUs. Memory is weights plus KV cache for one request, using FP8 KV cache where supported and FP16/BF16 otherwise. No guarantee of runtime support, usable performance, or that a matching quantized build exists. Pricing methodology.

Lium

Built for agents: CLI, SDK and MCP server. Your agent rents and runs GPUs itself.

A permissionless marketplace. 1000+ nodes from independent providers worldwide.

Hard to find nodes available; B200 and B300 Blackwell nodes listed now.

Consumer + DC grade cards for cheap. H100s from $1/hr, RTX 5090s from $0.35/hr.

View Pricing

Capabilities

What Qwen3-4B FP8 accepts and can do, as published by Alibaba Cloud.

Text Accepts and generates natural-language text.
Reasoning Thinks before it answers, always on or as a switchable mode.
Function calling Connect to external tools, APIs, and systems.
Structured output Return responses in structured formats like JSON.

Common questions

What is Qwen3-4B FP8 good for?

Edge and on-device deployment, local chat and small tool-calling loops. Apache 2.0 weights at the light end of the Qwen3 lineup, small enough for a single consumer GPU.

When is Qwen3-4B FP8 not a good fit?

Image, video or audio input: it is text only. Heavier reasoning and long-document work, which the larger dense and MoE models in the same lineup are sized for.

What is the cheapest way to run Qwen3-4B FP8?

No provider we track hosts it; self-hosting on the cheapest rental that fits (1x RTX 3060, $0.08 per hour) costs about $58 a month.

Can I self-host Qwen3-4B FP8?

Yes. The weights are Apache 2.0 licensed. At 4-bit it needs about 9 GB of GPU memory, which starts at roughly $58 a month on the cheapest rental that fits.