The H20 is newer, with 6x the memory and 8.9x the bandwidth.

At a glance

Memory

6x more on H20

H20
96 GB
RTX 5000
16 GB

Memory bandwidth

8.9x higher on H20

H20
4,000 GB/s
RTX 5000
448 GB/s

Cheapest on-demand

H20
--
RTX 5000
$0.10 /GPU/hr

Price comparison

Median price per GPU per hour by billing type, with the cheapest listing under it.

Billing H20 RTX 5000 Difference
On-demand No on-demand listings $0.60 /GPU/hr from $0.10
Reserved No reserved listings -- /GPU/hr from $0.09 (1 mo)
Spot No spot listings -- /GPU/hr from $0.05

Heads up: A provider's own page may quote a different figure, for example on tax, region or a promotion. A monthly-only plan shows a derived hourly rate. Medians are across providers, one vote each, so a large catalog does not outweigh a small one. No median for reserved and spot on the RTX 5000: we only show one when at least 3 providers list the GPU on that billing type. Verify before provisioning. More on how we price.

Price history

H20 vs RTX 5000 price history

Weekly median on-demand price per GPU per hour

Last 12 months
Aggregating historical prices...

Specs comparison

Spec H20 RTX 5000 Difference
Memory
Capacity 96 GB HBM3 16 GB GDDR6 6x more on H20
Bandwidth 4,000 GB/s 448 GB/s 8.9x higher on H20
Bus width 256-bit
Platform
Interconnect PCIe only NVLink 50 GB/s NVLink on RTX 5000 only
Board power 400 W 265 W 51% higher on H20
Released Q1 2024 Q3 2018 5 years newer on H20
Precision
Supported formats FP8FP16BF16TF32FP32FP64INT8 FP16FP32INT4INT8

Where to rent them

Providers that rent these GPUs, with each one's cheapest rate. No provider we track offers both right now.

Similar GPUs

Other comparisons in the same class.

Our data for Nvidia H20 was last updated on Sept. 14, 2026, and for Nvidia RTX 5000 on Sept. 14, 2026.