The H20 has 2x the memory and 3x the bandwidth.

At a glance

Memory

2x more on H20

H20
96 GB
RTX PRO 5000
48 GB

Memory bandwidth

3x higher on H20

H20
4.00 TB/s
RTX PRO 5000
1.34 TB/s

Cheapest on-demand

H20
--
RTX PRO 5000
$0.60 /GPU/hr

Price comparison

Median price per GPU per hour by billing type, with the cheapest listing under it.

Billing H20 RTX PRO 5000 Difference
On-demand No on-demand listings -- /GPU/hr from $0.60
Reserved No reserved listings $0.93 /GPU/hr from $0.50 (24 mo)
Spot No spot listings -- /GPU/hr from $0.18

Heads up: A provider's own page may quote a different figure, for example on tax, region or a promotion. A monthly-only plan shows a derived hourly rate. Medians are across providers, one vote each, so a large catalog does not outweigh a small one. No median for on-demand and spot on the RTX PRO 5000: we only show one when at least 3 providers list the GPU on that billing type. Verify before provisioning. More on how we price.

Price history

H20 vs RTX PRO 5000 price history

Weekly median on-demand price per GPU per hour

Last 7 months
Aggregating historical prices...

Specs comparison

Spec H20 RTX PRO 5000 Difference
Memory
Capacity 96 GB HBM3 48 GB GDDR7 2x more on H20
Bandwidth 4,000 GB/s 1,344 GB/s 3x higher on H20
Bus width 512-bit
Platform
Interconnect PCIe only PCIe only
Board power 400 W 300 W 33% higher on H20
Released Q1 2024 Q1 2025 15 months newer on RTX PRO 5000
Precision
Supported formats FP8FP16BF16TF32FP32FP64INT8 FP4FP8FP16BF16TF32FP32INT8

Where to rent them

Providers that rent these GPUs, with each one's cheapest rate. No provider we track offers both right now.

Similar GPUs

Other comparisons in the same class.

Our data for Nvidia H20 was last updated on Sept. 14, 2026, and for Nvidia RTX PRO 5000 on Sept. 14, 2026.