A data center GPU against a consumer card, one Hopper and one Ada Lovelace: 141 GB HBM3e against 24 GB GDDR6X, 4.8x the memory bandwidth on the H200, and NVLink 900 GB/s on the H200 where the RTX 4090 is PCIe only.
At a glance
Updated 7 minutes ago- Memory
- 141 GB
- HBM3e
- Memory bandwidth
- 4.80 TB/s
- From
- $2.09 /GPU/hr
- 46 providers
- Memory
- 24 GB
- GDDR6X
- Memory bandwidth
- 1.01 TB/s
- From
- $0.23 /GPU/hr
- 18 providers
Price comparison
Cheapest listed price per GPU per hour by billing type, and the median across providers.
| Billing | H200 | RTX 4090 | Difference |
|---|---|---|---|
| On-demand | $2.09 | $0.23 | 8.9x more expensive on H200 |
| Spot | $1.47 | $0.16 | 9.2x more expensive on H200 |
| Reserved | $2.29 | $0.27 | 8.4x more expensive on H200 |
| Median | $4.29 | $0.44 | 9.8x more expensive on H200 |
Median: Median across providers, one vote each, so a large catalog does not outweigh a small one.
Price history
H200 vs RTX 4090 price history
Weekly median on-demand price per GPU per hour
Specs comparison
| Spec | H200 | RTX 4090 | Difference |
|---|---|---|---|
| Memory | |||
| Capacity | 141 GB HBM3e | 24 GB GDDR6X | 5.9x more on H200 |
| Bandwidth | 4,800 GB/s | 1,010 GB/s | 4.8x higher on H200 |
| Bus width | 384-bit | ||
| Compute · dense | |||
| FP8 | 1,979 TFLOPS | 330.3 TFLOPS | 6x higher on H200 |
| FP16 / BF16 | 989.5 TFLOPS | 165.2 TFLOPS | 6x higher on H200 |
| INT8 | 1,979 TOPS | 660.6 TOPS | 3x higher on H200 |
| FP32 | 67 TFLOPS | 82.6 TFLOPS | 1.2x higher on RTX 4090 |
| FP64 | 34 TFLOPS | Not supported | H200 only |
| Platform | |||
| Interconnect | NVLink 900 GB/s | PCIe only | NVLink on H200 only |
| Board power | 700 W | 450 W | 1.6x higher on H200 |
| Released | Q4 2023 | Q4 2022 | 13 months newer on H200 |
| Precision | |||
| Supported formats | FP8FP16BF16TF32FP32FP64INT8 | FP8FP16BF16TF32FP32INT4INT8 | |
Compute: Vendor peak figures, dense and per GPU. Not measured throughput.
Source: H200 datasheet and RTX 4090 datasheet.
Where to rent them
Providers listing these GPUs, those with both first, so you can switch without moving clouds.
| Provider | H200 /GPU/hr | RTX 4090 /GPU/hr |
|---|---|---|
Lium
|
On-Demand $2.90 | On-Demand $0.58 |
GPU.ai
|
On-Demand $3.29 | On-Demand $0.34 |
Runpod
|
On-Demand $3.79 | On-Demand $0.34 |
Koyeb
|
On-Demand $3.00 | -- |
Massed Compute
|
On-Demand $3.62 | -- |
Vast.ai
|
On-Demand $3.97 | -- |
Verda
|
On-Demand $4.00 | -- |
Lyceum
|
On-Demand $4.29 | -- |
Theta EdgeCloud
|
-- | On-Demand $0.23 |
Salad
|
-- | On-Demand $0.30 |
Novita
|
-- | On-Demand $0.33 |
Packet·ai
|
-- | On-Demand $0.39 |
Sesterce
|
-- | On-Demand $0.66 |
46 providers list the H200 and 18 the RTX 4090. Every listing is on the H200 page and the RTX 4090 page.
Similar GPUs
Other comparisons in the same class.
Our data for Nvidia H200 was last updated on Sept. 7, 2026, and for Nvidia RTX 4090 on Sept. 7, 2026.