Nvidia T4

Nvidia T4

Low-cost inference GPU with wide cloud availability.

Compare vs other GPUs →
Aggregating historical prices...

Weekly median price per GPU per hour. Nvidia T4 price history (JSON).

At a glance

Hardware

Architecture
Turing
Memory per GPU
16 GB GDDR6
Memory bandwidth
300 GB/s
Release date
Q3 2018

Market Updated 5 minutes ago

Cheapest in stock
$0.11 / GPU / hr
on-demand · 1x · Vast.ai
Median price
$0.64 / GPU / hr
on-demand
90-day trend
−6%
median on-demand
Coverage
11 providers
5 of 122 configs in stock

T4 Pricing and Availability

11 providers

How this list works

The two views

By provider shows one card per company, placed where its best offer ranked. By configuration lists every offer.

Order

What you can rent comes first: in stock, then waitlist, then not reported, then out of stock. Priced offers rank ahead of quote-only, and on-demand ahead of other billing types.

Within a group, five factors set the order:

  1. Location: datacenter proximity, blended with provider HQ.
  2. Price: hourly price, per GPU and in total.
  3. Billing type: reserved ahead of spot, spot ahead of quote-only.
  4. Specs: more VRAM, vCPUs and RAM.
  5. Provider diversity: a provider's repeat rows rank slightly lower, so one company can't take all the top spots.

Search

We match the provider, its country, GPU model, form factor, billing type, availability and instance name. Matching is partial and case-insensitive. Everyday words work too, so "interruptible" finds spot and "sold out" finds out of stock.

Transparency and funding

  • Ads and sponsors: Paid placements sit at the top of the list and are always labeled as sponsored content. Sponsorship never influences the organic ranking itself.
  • Affiliates: Affiliate links are marked. We may earn a commission if you click them, but commissions never affect the order.
  • Prices: Shown in USD, converted at daily reference rates where a provider publishes in another currency. A month means 720 hours. How we estimate costs.
Vast.ai logo

Vast.ai

Our sponsor

United States of America flag USA 3 configs 1x

On-Demand from $0.11 Spot from $0.06
From $0.11 / GPU / hr On-Demand Visit website
Zenlayer logo

Zenlayer

In stock

United States of America flag USA 2 configs 1x-2x

On-Demand from $0.56
From $0.56 / GPU / hr On-Demand PCIe Visit website
Theta EdgeCloud logo

United States of America flag USA 2 configs 1x-2x

On-Demand from $0.20
From $0.20 / GPU / hr On-Demand Visit website
Cerebrium logo

United States of America flag USA 4 configs 1x-8x

On-Demand from $0.59
From $0.59 / GPU / hr On-Demand Visit website
Hugging Face logo

United States of America flag USA 2 configs 1x

On-Demand from $0.40
From $0.40 / GPU / hr On-Demand Visit website
Microsoft Azure logo

United States of America flag USA 16 configs 1x-4x

On-Demand from $0.53 Reserved from $0.20 Spot from $0.10
From $0.53 / GPU / hr On-Demand Visit website
Amazon Web Services logo

AWS

United States of America flag USA 21 configs 1x-8x

On-Demand from $0.53 Reserved from $0.23
From $0.53 / GPU / hr On-Demand Visit website
Google Cloud logo

United States of America flag USA 48 configs 1x-4x

On-Demand from $0.42 Reserved from $0.21 Spot from $0.21
From $0.42 / GPU / hr On-Demand Visit website
Replicate logo

United States of America flag USA 1 config 1x

On-Demand from $0.81
From $0.81 / GPU / hr On-Demand Visit website
Alibaba Cloud logo

Singapore flag Singapore 12 configs 1x-4x

On-Demand from $1.12 Reserved from $0.62
From $1.12 / GPU / hr On-Demand Visit website
Leaseweb logo

Netherlands flag Netherlands 11 configs 1x-2x

Reserved from $0.23
From $0.23 / GPU / hr Reserved (1mo) Visit website

Heads up: A provider's own page may quote a different figure, for example on tax, region or a promotion. A monthly-only plan shows a derived hourly rate. Verify before provisioning. More on how we price.

What size AI models can the T4 run?

One T4 has 16 GB of VRAM. In practice, that's enough memory for roughly 8B parameters at 4-bit or 2B at 16-bit, assuming a 32K context. Below are some open-weight LLMs, with the estimated memory and GPUs each one needs.

Model Parameters 4-bitINT4 / FP4 8-bitFP8 / INT8 16-bitFP16 / BF16
Alibaba Cloud logo Qwen3.8-27B
27B
2 GPUs 19 GB VRAM · $922/mo
4 GPUs 31 GB VRAM · $1,843/mo
8 GPUs 58 GB VRAM · $3,686/mo
Google Cloud logo Gemma 4 31B
30.7B
2 GPUs 24 GB VRAM · $922/mo
4 GPUs 38 GB VRAM · $1,843/mo
8 GPUs 69 GB VRAM · $3,686/mo
OpenAI logo GPT-OSS-120B
117B 5.1B active
8 GPUs 68 GB VRAM · $3,686/mo
9 GPUs 120 GB VRAM
17 GPUs 237 GB VRAM
DeepSeek logo DeepSeek V4 Flash
284B 13B active
12 GPUs 161 GB VRAM
21 GPUs 289 GB VRAM
40 GPUs 573 GB VRAM
Z.AI logo GLM-5.3-Flash
320B 18B active
13 GPUs 178 GB VRAM
23 GPUs 322 GB VRAM
45 GPUs 642 GB VRAM
MiniMax logo MiniMax-M3
428B 23B active
17 GPUs 241 GB VRAM
31 GPUs 434 GB VRAM
60 GPUs 862 GB VRAM
Moonshot AI logo Kimi K3
2.8T 104B active
108 GPUs 1,545 GB VRAM
195 GPUs 2,805 GB VRAM
390 GPUs 5,605 GB VRAM

Estimates based on the median on-demand rate. Memory is weights plus FP16/BF16 KV cache at 32K context per request. GPU counts assume 90% of advertised VRAM is usable. No guarantee of runtime support, usable performance, or that a matching quantized build exists. How we estimate costs.

Technical Specifications

Nvidia T4 · Per GPU

Compute · dense
FP16 / BF16 65 TFLOPS
INT8 130 TOPS
FP32 8.1 TFLOPS
Precision support FP16FP32INT4INT8
Memory
Capacity 16 GB GDDR6
Bandwidth 300 GB/s
Bus width 256-bit
ECC Yes
Silicon
Architecture Turing
Process TSMC 12nm FFN
Transistors 13.6 billion
Shader cores 2,560 CUDA cores
Matrix cores 320 Tensor cores
Compute units 40 SMs
Fabric and host
Host interface PCIe 3.0 x16
Power
Board power 70 W
Cooling Passive

Source: official Nvidia T4 datasheet.

Frequently Asked Questions

How much does the T4 cost per hour?

As of September 8, 2026, the median on-demand price is $0.64 per GPU per hour across 10 providers.

Billing type Configs Median / GPU / hr Cheapest
On-demand 42 $0.64 $0.11 (in stock, Vast.ai)
Reserved 63 $0.43 $0.20 (36 mo)
Spot 17 $0.26 $0.06 (in stock, Vast.ai)

Who has the cheapest T4?

As of September 8, 2026, the cheapest verified in-stock on-demand T4 tracked by GetDeploying is $0.11 per GPU per hour from Vast.ai. Cheapest verified in stock on other billing types: spot $0.06, also from Vast.ai.

How much does the T4 cost per month?

As of September 8, 2026, at 720 hours per month, one T4 costs an estimated $461 at the median on-demand price. Cheapest verified in stock: $79 per month on-demand, $43 spot.

Where can I rent a T4?

GetDeploying currently tracks T4 configs from 11 providers. Vast.ai and Zenlayer have verified in-stock on-demand configs. See the full price comparison above for every provider and config.

Are T4 prices going up or down?

As of September 8, 2026, the median on-demand price has fallen about 6% over the past 90 days to $0.64 per GPU per hour, though it is about 5% above where it was a year ago.

How many T4 GPUs do I need?

One T4 runs models up to roughly 8B parameters at 4-bit quantization or 2B at 16-bit, assuming a 32K context. Larger models run across multiple GPUs: the model table above shows the estimated memory and GPU count for popular open-weight LLMs.

Why choose the T4?

16GB GDDR6 in a 70W low-power form factor. Very low cost per hour across cloud providers. INT8 Tensor Cores for efficient inference on smaller models.

When is the T4 not a good fit?

Turing architecture lacks BF16 and FP8. 16GB VRAM limits model sizes. Slow for training. For production inference, the L4 offers significantly better throughput.

Alternatives to Nvidia T4

Last updated