A data center GPU against a consumer card, one Hopper and one Ada Lovelace: 141 GB HBM3e against 12 GB GDDR6X, 9.5x the memory bandwidth on the H200, and NVLink 900 GB/s on the H200 where the RTX 4070 is PCIe only.
At a glance
Updated 6 minutes ago- Memory
- 141 GB
- HBM3e
- Memory bandwidth
- 4.80 TB/s
- From
- $2.09 /GPU/hr
- 46 providers
- Memory
- 12 GB
- GDDR6X
- Memory bandwidth
- 504 GB/s
- From
- $0.07 /GPU/hr
- 3 providers
Price comparison
Cheapest listed price per GPU per hour by billing type, and the median across providers.
| Billing | H200 | RTX 4070 | Difference |
|---|---|---|---|
| On-demand | $2.09 | $0.07 | 29x more expensive on H200 |
| Spot | $1.32 | $0.07 | 19x more expensive on H200 |
| Reserved | $2.29 | No reserved listings | |
| Median | $4.40 | $0.21 | 21x more expensive on H200 |
Median: Median across providers, one vote each, so a large catalog does not outweigh a small one.
Price history
H200 vs RTX 4070 price history
Weekly median on-demand price per GPU per hour
Specs comparison
| Spec | H200 | RTX 4070 | Difference |
|---|---|---|---|
| Memory | |||
| Capacity | 141 GB HBM3e | 12 GB GDDR6X | 12x more on H200 |
| Bandwidth | 4,800 GB/s | 504 GB/s | 9.5x higher on H200 |
| Bus width | 192-bit | ||
| Compute · dense | |||
| FP8 | 1,979 TFLOPS | 116.6 TFLOPS | 17x higher on H200 |
| FP16 / BF16 | 989.5 TFLOPS | 58.3 TFLOPS | 17x higher on H200 |
| INT8 | 1,979 TOPS | 233.2 TOPS | 8.5x higher on H200 |
| FP32 | 67 TFLOPS | 29.1 TFLOPS | 2.3x higher on H200 |
| FP64 | 34 TFLOPS | Not supported | H200 only |
| Platform | |||
| Interconnect | NVLink 900 GB/s | PCIe only | NVLink on H200 only |
| Board power | 700 W | 200 W | 3.5x higher on H200 |
| Released | Q4 2023 | Q2 2023 | 7 months newer on H200 |
| Precision | |||
| Supported formats | FP8FP16BF16TF32FP32FP64INT8 | FP8FP16BF16TF32FP32INT4INT8 | |
Compute: Vendor peak figures, dense and per GPU. Not measured throughput.
Source: H200 datasheet and RTX 4070 datasheet.
Where to rent them
Providers listing these GPUs, those with both first, so you can switch without moving clouds.
| Provider | H200 /GPU/hr | RTX 4070 /GPU/hr |
|---|---|---|
|
|
On-Demand $3.34 | On-Demand $0.07 |
|
|
On-Demand $3.00 | -- |
|
|
On-Demand $3.29 | -- |
|
|
On-Demand $3.59 | -- |
|
|
On-Demand $3.62 | -- |
|
|
On-Demand $3.65 | -- |
|
|
On-Demand $4.00 | -- |
|
|
On-Demand $4.29 | -- |
|
|
-- | On-Demand $0.21 |
|
|
-- | On-Demand $0.22 |
46 providers list the H200 and 3 the RTX 4070. Every listing is on the H200 page and the RTX 4070 page.
Similar GPUs
Other comparisons in the same class.
Our data for Nvidia H200 was last updated on Sept. 7, 2026, and for Nvidia RTX 4070 on Sept. 7, 2026.