The H20 is newer, with 48x the memory and 50x the bandwidth.

At a glance

Memory

48x more on H20

H20
96 GB
P620
2 GB

Memory bandwidth

50x higher on H20

H20
4,000 GB/s
P620
80 GB/s

Cheapest on-demand

H20
--
P620
--

Price comparison

Median price per GPU per hour by billing type, with the cheapest listing under it.

Price history

H20 vs P620 price history

Weekly median on-demand price per GPU per hour

Last 9 months
Aggregating historical prices...

Specs comparison

Spec H20 P620 Difference
Memory
Capacity 96 GB HBM3 2 GB GDDR5 48x more on H20
Bandwidth 4,000 GB/s 80 GB/s 50x higher on H20
Bus width 128-bit
Platform
Interconnect PCIe only PCIe only
Board power 400 W 40 W 10x higher on H20
Released Q1 2024 Q1 2018 6 years newer on H20
Precision
Supported formats FP8FP16BF16TF32FP32FP64INT8 FP16FP32

Source: P620 datasheet.

Similar GPUs

Other comparisons in the same class.

Our data for Nvidia H20 was last updated on Sept. 14, 2026, and for Nvidia P620 on Sept. 14, 2026.