The H20 is newer, with 6x the memory and 13x the bandwidth.

At a glance

Memory

6x more on H20

H20
96 GB
T4
16 GB

Memory bandwidth

13x higher on H20

H20
4,000 GB/s
T4
300 GB/s

Cheapest on-demand

H20
--
T4
$0.10 /GPU/hr

Price comparison

Median price per GPU per hour by billing type, with the cheapest listing under it.

Billing H20 T4 Difference
On-demand No on-demand listings $0.64 /GPU/hr from $0.10
Reserved No reserved listings $0.43 /GPU/hr from $0.20 (36 mo)
Spot No spot listings $0.26 /GPU/hr from $0.06

Heads up: A provider's own page may quote a different figure, for example on tax, region or a promotion. A monthly-only plan shows a derived hourly rate. Medians are across providers, one vote each, so a large catalog does not outweigh a small one. Verify before provisioning. More on how we price.

Price history

H20 vs T4 price history

Weekly median on-demand price per GPU per hour

Last 12 months
Aggregating historical prices...

Specs comparison

Spec H20 T4 Difference
Memory
Capacity 96 GB HBM3 16 GB GDDR6 6x more on H20
Bandwidth 4,000 GB/s 300 GB/s 13x higher on H20
Bus width 256-bit
Platform
Interconnect PCIe only PCIe only
Board power 400 W 70 W 5.7x higher on H20
Released Q1 2024 Q3 2018 5 years newer on H20
Precision
Supported formats FP8FP16BF16TF32FP32FP64INT8 FP16FP32INT4INT8

Source: T4 datasheet.

Where to rent them

Providers that rent these GPUs, with each one's cheapest rate. No provider we track offers both right now.

0 providers list the H20 and 11 the T4. Every listing is on the H20 page and the T4 page.

Similar GPUs

Other comparisons in the same class.

Our data for Nvidia H20 was last updated on Sept. 14, 2026, and for Nvidia T4 on Sept. 14, 2026.