A workstation GPU against a data center card, one Ampere and one Hopper: 24 GB GDDR6 against 141 GB HBM3e and 6.2x the memory bandwidth on the H200.
At a glance
Updated 4 minutes ago- Memory
- 24 GB
- GDDR6
- Memory bandwidth
- 768 GB/s
- From
- $0.23 /GPU/hr
- 13 providers
- Memory
- 141 GB
- HBM3e
- Memory bandwidth
- 4.80 TB/s
- From
- $2.09 /GPU/hr
- 45 providers
Price comparison
Cheapest listed price per GPU per hour by billing type, and the median across providers.
| Billing | A5000 | H200 | Difference |
|---|---|---|---|
| On-demand | $0.23 | $2.09 | 9x more expensive on H200 |
| Spot | $0.09 | $1.32 | 15x more expensive on H200 |
| Reserved | $0.23 | $2.29 | 9.9x more expensive on H200 |
| Median | $0.75 | $4.29 | 5.7x more expensive on H200 |
Median: Median across providers, one vote each, so a large catalog does not outweigh a small one.
Price history
A5000 vs H200 price history
Weekly median on-demand price per GPU per hour
Specs comparison
| Spec | A5000 | H200 | Difference |
|---|---|---|---|
| Memory | |||
| Capacity | 24 GB GDDR6 | 141 GB HBM3e | 5.9x more on H200 |
| Bandwidth | 768 GB/s | 4,800 GB/s | 6.2x higher on H200 |
| Bus width | 384-bit | ||
| Compute · dense | |||
| FP8 | Not supported | 1,979 TFLOPS | H200 only |
| FP16 / BF16 | 111.1 TFLOPS | 989.5 TFLOPS | 8.9x higher on H200 |
| INT8 | 1,979 TOPS | ||
| FP32 | 27.8 TFLOPS | 67 TFLOPS | 2.4x higher on H200 |
| FP64 | Not supported | 34 TFLOPS | H200 only |
| Platform | |||
| Interconnect | NVLink 112 GB/s | NVLink 900 GB/s | 8x higher on H200 |
| Board power | 230 W | 700 W | 3x higher on H200 |
| Released | Q2 2021 | Q4 2023 | 3 years newer on H200 |
| Precision | |||
| Supported formats | FP16BF16TF32FP32INT4INT8 | FP8FP16BF16TF32FP32FP64INT8 | |
Compute: Vendor peak figures, dense and per GPU. Not measured throughput.
Source: A5000 datasheet and H200 datasheet.
Where to rent them
Providers listing these GPUs, those with both first, so you can switch without moving clouds.
| Provider | A5000 /GPU/hr | H200 /GPU/hr |
|---|---|---|
Vast.ai
|
On-Demand $0.23 | On-Demand $3.59 |
GPU.ai
|
On-Demand $0.25 | On-Demand $3.29 |
Runpod
|
On-Demand $0.27 | On-Demand $4.59 |
Salad
|
On-Demand $0.25 | -- |
Runcrate
|
On-Demand $1.56 | -- |
Sesterce
|
On-Demand $1.56 | -- |
Exoscale
|
On-Demand $1.14 | -- |
Paperspace
|
On-Demand $1.38 | -- |
Koyeb
|
-- | On-Demand $3.00 |
Lium
|
-- | On-Demand $3.00 |
Massed Compute
|
-- | On-Demand $3.62 |
Verda
|
-- | On-Demand $4.00 |
Lyceum
|
-- | On-Demand $4.29 |
13 providers list the A5000 and 45 the H200. Every listing is on the A5000 page and the H200 page.
Similar GPUs
Other comparisons in the same class.
Our data for Nvidia A5000 was last updated on Sept. 7, 2026, and for Nvidia H200 on Sept. 7, 2026.