Two Nvidia data center GPUs, one Ampere and one Hopper: 16 GB GDDR6 against 141 GB HBM3e, 24x the memory bandwidth on the H200, and NVLink 900 GB/s on the H200 where the A16 is PCIe only.
At a glance
Updated 4 minutes ago- Memory
- 16 GB
- GDDR6
- Memory bandwidth
- 200 GB/s
- From
- $0.47 /GPU/hr
- 3 providers
- Memory
- 141 GB
- HBM3e
- Memory bandwidth
- 4.80 TB/s
- From
- $2.09 /GPU/hr
- 45 providers
Price comparison
Cheapest listed price per GPU per hour by billing type, and the median across providers.
| Billing | A16 | H200 | Difference |
|---|---|---|---|
| On-demand | $0.47 | $2.09 | 4.4x more expensive on H200 |
| Spot | No spot listings | $1.32 | |
| Reserved | No reserved listings | $2.29 | |
| Median | $0.56 | $4.29 | 7.7x more expensive on H200 |
Median: Median across providers, one vote each, so a large catalog does not outweigh a small one.
Price history
A16 vs H200 price history
Weekly median on-demand price per GPU per hour
Specs comparison
| Spec | A16 | H200 | Difference |
|---|---|---|---|
| Memory | |||
| Capacity | 16 GB GDDR6 | 141 GB HBM3e | 8.8x more on H200 |
| Bandwidth | 200 GB/s | 4,800 GB/s | 24x higher on H200 |
| Bus width | 128-bit | ||
| Compute · dense | |||
| FP8 | Not supported | 1,979 TFLOPS | H200 only |
| FP16 / BF16 | 17.9 TFLOPS | 989.5 TFLOPS | 55x higher on H200 |
| INT8 | 35.9 TOPS | 1,979 TOPS | 55x higher on H200 |
| FP32 | 4.5 TFLOPS | 67 TFLOPS | 15x higher on H200 |
| FP64 | Not supported | 34 TFLOPS | H200 only |
| Platform | |||
| Interconnect | PCIe only | NVLink 900 GB/s | NVLink on H200 only |
| Released | Q2 2021 | Q4 2023 | 3 years newer on H200 |
| Precision | |||
| Supported formats | FP16BF16TF32FP32INT4INT8 | FP8FP16BF16TF32FP32FP64INT8 | |
Compute: Vendor peak figures, dense and per GPU. Not measured throughput.
Source: A16 datasheet and H200 datasheet.
Where to rent them
Providers listing these GPUs, those with both first, so you can switch without moving clouds.
| Provider | A16 /GPU/hr | H200 /GPU/hr |
|---|---|---|
Vultr
|
On-Demand $0.47 | -- |
Runcrate
|
On-Demand $0.56 | -- |
Sesterce
|
On-Demand $0.56 | -- |
Koyeb
|
-- | On-Demand $3.00 |
Lium
|
-- | On-Demand $3.00 |
GPU.ai
|
-- | On-Demand $3.29 |
Vast.ai
|
-- | On-Demand $3.59 |
Massed Compute
|
-- | On-Demand $3.62 |
Verda
|
-- | On-Demand $4.00 |
Lyceum
|
-- | On-Demand $4.29 |
Runpod
|
-- | On-Demand $4.59 |
3 providers list the A16 and 45 the H200. Every listing is on the A16 page and the H200 page.
Similar GPUs
Other comparisons in the same class.
Our data for Nvidia A16 was last updated on Sept. 7, 2026, and for Nvidia H200 on Sept. 7, 2026.