A data center GPU against a workstation card, one Hopper and one Blackwell: 141 GB HBM3e against 24 GB GDDR7, 7.1x the memory bandwidth on the H200, and NVLink 900 GB/s on the H200 where the RTX PRO 4000 is PCIe only.
At a glance
Updated 8 minutes ago- Memory
- 141 GB
- HBM3e
- Memory bandwidth
- 4.80 TB/s
- From
- $2.09 /GPU/hr
- 46 providers
- Memory
- 24 GB
- GDDR7
- Memory bandwidth
- 672 GB/s
- From
- $20.00 /GPU/hr
- 3 providers
Price comparison
Cheapest listed price per GPU per hour by billing type, and the median across providers.
| Billing | H200 | RTX PRO 4000 | Difference |
|---|---|---|---|
| On-demand | $2.09 | $20.00 | 9.6x more expensive on RTX PRO 4000 |
| Spot | $1.47 | $13.33 | 9.1x more expensive on RTX PRO 4000 |
| Reserved | $2.29 | $0.26 | 8.7x more expensive on H200 |
| Median | $4.29 | $20.00 | 4.7x more expensive on RTX PRO 4000 |
Median: Median across providers, one vote each, so a large catalog does not outweigh a small one.
Price history
H200 vs RTX PRO 4000 price history
Weekly median on-demand price per GPU per hour
Specs comparison
| Spec | H200 | RTX PRO 4000 | Difference |
|---|---|---|---|
| Memory | |||
| Capacity | 141 GB HBM3e | 24 GB GDDR7 | 5.9x more on H200 |
| Bandwidth | 4,800 GB/s | 672 GB/s | 7.1x higher on H200 |
| Bus width | 192-bit | ||
| Compute · dense | |||
| FP4 | Not supported | 589 TFLOPS | RTX PRO 4000 only |
| FP8 | 1,979 TFLOPS | 294.5 TFLOPS | 6.7x higher on H200 |
| FP16 / BF16 | 989.5 TFLOPS | 147.3 TFLOPS | 6.7x higher on H200 |
| INT8 | 1,979 TOPS | 294.5 TOPS | 6.7x higher on H200 |
| FP32 | 67 TFLOPS | 37 TFLOPS | 1.8x higher on H200 |
| FP64 | 34 TFLOPS | Not supported | H200 only |
| Platform | |||
| Interconnect | NVLink 900 GB/s | PCIe only | NVLink on H200 only |
| Board power | 700 W | 145 W | 4.8x higher on H200 |
| Released | Q4 2023 | Q1 2025 | 16 months newer on RTX PRO 4000 |
| Precision | |||
| Supported formats | FP8FP16BF16TF32FP32FP64INT8 | FP4FP8FP16BF16TF32FP32INT8 | |
Compute: Vendor peak figures, dense and per GPU. Not measured throughput.
Source: H200 datasheet and RTX PRO 4000 datasheet.
Where to rent them
Providers listing these GPUs, those with both first, so you can switch without moving clouds.
| Provider | H200 /GPU/hr | RTX PRO 4000 /GPU/hr |
|---|---|---|
Vast.ai
|
On-Demand $3.97 | On-Demand $20.00 |
Runpod
|
On-Demand $3.79 | Reservation on request |
Lium
|
On-Demand $2.90 | -- |
Koyeb
|
On-Demand $3.00 | -- |
GPU.ai
|
On-Demand $3.29 | -- |
Massed Compute
|
On-Demand $3.62 | -- |
Verda
|
On-Demand $4.00 | -- |
Lyceum
|
On-Demand $4.29 | -- |
Database Mart
|
-- | Reserved (24mo) $0.26 |
46 providers list the H200 and 3 the RTX PRO 4000. Every listing is on the H200 page and the RTX PRO 4000 page.
Similar GPUs
Other comparisons in the same class.
Our data for Nvidia H200 was last updated on Sept. 7, 2026, and for Nvidia RTX PRO 4000 on Sept. 7, 2026.