Home
LLMs
Gemma 4 12B

Gemma 4 12B

An 11.95B dense Gemma 4 model and the first mid-sized Gemma with an encoder-free design that feeds image and audio inputs directly into the transformer. Apache 2.0 license.

Params: 11.95B
Context: 256K tokens
Cutoff: Jan 2025
Released: Jun 2026
License: Apache 2.0

Visit Google Cloud Compare vs other LLMs →

Hosted API pricing

How we price

Order

Providers are listed cheapest input rate first, then by output rate, a tie going to the creator's own listing. A provider that lists the model without a published rate sits at the end.

Prices

Base-tier, on-demand rates in USD per 1M tokens, converted at ECB reference rates where a provider publishes in another currency. Cached-input and batch rates show only where a provider publishes them. "Cheapest" marks the one provider with the lowest input and output pair; a tie wears no badge.

Cost

Input rate times the input tokens plus output rate times the output tokens, at the monthly volume set above the table. Cached-input, batch, long-context and reasoning-token billing are not modelled.

Transparency and funding

Affiliates: Affiliate links are marked. We may earn a commission if you click them, but commissions never affect the order.

Every provider serving Gemma 4 12B, cheapest input first. Set your monthly volume to see what each would bill.

Input M Output M

Every provider serving Gemma 4 12B, with its price per 1M input and output tokens and what the volume above would cost
Provider	Input /1M	Output /1M	Cost at 10M in + 2M out	Link
Google Cloud Creator	Open weights, no hosted price			Visit website

Heads up: Base-tier, on-demand rates per 1M tokens; cached, batch and long-context tiers excluded. A provider may serve a shorter context or a quantized build than the creator's release. Verify before provisioning. More on how we price.

Estimated cost to self-host

Gemma 4 12B needs about 11 GB of GPU memory at 4-bit with 32K context. The cheapest rental that fits is 1× RTX 3060 at about $50 a month.

Fits on 1 Single node ≤ 8

What it costs to self-host Gemma 4 12B at each precision: the memory it needs, the cheapest rental that holds it, that rental's month and the API volume it pays off at
Precision	Memory	Cheapest fit (32K context)(Full 256K context)	Cost /mo
4-bit INT4 / FP4	11 GB17 GB	1× RTX 3060	$50$173
8-bit FP8 / INT8	16 GB22 GB	2× RTX 3060	$101$173
16-bit FP16 / BF16	28 GB43 GB	2× RTX 4060 Ti	$173$202

Estimates based on median on-demand rates for Nvidia GPUs. Memory is weights plus KV cache for one request, using FP8 KV cache where supported and FP16/BF16 otherwise. No guarantee of runtime support, usable performance, or that a matching quantized build exists. How we estimate costs.

Vast.ai

Per-second billing. Pay only for what you use.

50+ GPU models from RTX 3060 to B200, from $0.04/hr

No minimums, no long-term contracts.

SOC2 certified · PyTorch, CUDA & TensorFlow templates ready

Learn more

Capabilities

What Gemma 4 12B accepts and can do, as published by Google Cloud.

Text Accepts and generates natural-language text.
Image Accepts images as input alongside text.
Audio Accepts audio as input.
Reasoning Thinks before it answers, always on or as a switchable mode.
Function calling Connect to external tools, APIs, and systems.
Structured output Return responses in structured formats like JSON.

Common questions

What is Gemma 4 12B good for?

Self-hosted work that takes audio as well as text and images, which the other mid-sized Gemma 4 models do not. Apache 2.0 weights, on a single consumer GPU.

When is Gemma 4 12B not a good fit?

Video input, and hosted tools like web search or code execution. No maximum output is published, and its knowledge is over a year older than its June 2026 release.

What is the cheapest way to run Gemma 4 12B?

No provider we track hosts it; self-hosting on the cheapest rental that fits (1x RTX 3060, $0.07 per hour) costs about $50 a month.

Can I self-host Gemma 4 12B?

Yes. The weights are Apache 2.0 licensed. At 4-bit it needs about 11 GB of GPU memory, which starts at roughly $50 a month on the cheapest rental that fits.