The H20 is newer, with 6x the memory and 20x the bandwidth.

At a glance

Memory

6x more on H20

A16
16 GB
H20
96 GB

Memory bandwidth

20x higher on H20

A16
200 GB/s
H20
4,000 GB/s

Cheapest on-demand

A16
$0.56 /GPU/hr
H20
--

Price comparison

Median price per GPU per hour by billing type, with the cheapest listing under it.

Billing A16 H20 Difference
On-demand -- /GPU/hr from $0.56 No on-demand listings

Heads up: A provider's own page may quote a different figure, for example on tax, region or a promotion. A monthly-only plan shows a derived hourly rate. Medians are across providers, one vote each, so a large catalog does not outweigh a small one. No median for on-demand on the A16: we only show one when at least 3 providers list the GPU on that billing type. Verify before provisioning. More on how we price.

Price history

A16 vs H20 price history

Weekly median on-demand price per GPU per hour

Last 12 months
Aggregating historical prices...

Specs comparison

Spec A16 H20 Difference
Memory
Capacity 16 GB GDDR6 96 GB HBM3 6x more on H20
Bandwidth 200 GB/s 4,000 GB/s 20x higher on H20
Bus width 128-bit
Platform
Interconnect PCIe only PCIe only
Released Q2 2021 Q1 2024 3 years newer on H20
Precision
Supported formats FP16BF16TF32FP32INT4INT8 FP8FP16BF16TF32FP32FP64INT8

Source: A16 datasheet .

Where to rent them

Providers that rent these GPUs, with each one's cheapest rate. No provider we track offers both right now.

Similar GPUs

Other comparisons in the same class.

Our data for Nvidia A16 was last updated on Sept. 14, 2026, and for Nvidia H20 on Sept. 14, 2026.