A data center GPU against a workstation card, one Grace Hopper and one Ada Lovelace: 96 GB HBM3 against 20 GB GDDR6, 14x the memory bandwidth on the GH200, and NVLink 900 GB/s on the GH200 where the RTX 4000 SFF Ada is PCIe only.
At a glance
Memory
- GH200
- 96 GB
- RTX 4000 SFF Ada
- 20 GB
4.8x more on GH200
Memory bandwidth
- GH200
- 4,000 GB/s
- RTX 4000 SFF Ada
- 280 GB/s
14x higher on GH200
Cheapest on-demand
- GH200
- $6.50 /GPU/hr
- RTX 4000 SFF Ada
- $0.43 /GPU/hr
15x more expensive on GH200
Price comparison
Median price per GPU per hour by billing type, with the cheapest listing under it.
| Billing | GH200 | RTX 4000 SFF Ada | Difference |
|---|---|---|---|
| On-demand | -- /GPU/hr from $6.50 | -- /GPU/hr from $0.43 | |
| Spot | Sold out | No spot listings |
Heads up: A provider's own page may quote a different figure, for example on tax, region or a promotion. A monthly-only plan shows a derived hourly rate. Medians are across providers, one vote each, so a large catalog does not outweigh a small one. No median for on-demand on the GH200 and on-demand on the RTX 4000 SFF Ada: we only show one when at least 3 providers list the GPU on that billing type. Verify before provisioning. More on how we price.
Price history
GH200 vs RTX 4000 SFF Ada price history
Weekly median on-demand price per GPU per hour
Specs comparison
| Spec | GH200 | RTX 4000 SFF Ada | Difference |
|---|---|---|---|
| Memory | |||
| Capacity | 96 GB HBM3 | 20 GB GDDR6 | 4.8x more on GH200 |
| Bandwidth | 4,000 GB/s | 280 GB/s | 14x higher on GH200 |
| Bus width | 160-bit | ||
| Compute · dense | |||
| FP8 | 1,979 TFLOPS | 153.4 TFLOPS | 13x higher on GH200 |
| FP16 / BF16 | 989.5 TFLOPS | 76.7 TFLOPS | 13x higher on GH200 |
| INT8 | 1,979 TOPS | ||
| FP32 | 67 TFLOPS | 19.2 TFLOPS | 3.5x higher on GH200 |
| FP64 | 34 TFLOPS | Not supported | GH200 only |
| Platform | |||
| Interconnect | NVLink 900 GB/s | PCIe only | NVLink on GH200 only |
| Released | Q2 2023 | Q2 2023 | |
| Precision | |||
| Supported formats | FP8FP16BF16TF32FP32FP64INT8 | FP8FP16BF16TF32FP32INT4INT8 | |
Compute: Vendor peak figures, dense and per GPU. Not measured throughput.
Source: GH200 datasheet and RTX 4000 SFF Ada datasheet.
Where to rent them
Providers listing these GPUs, those with both first, so you can switch without moving clouds.
Similar GPUs
Other comparisons in the same class.
-
Nvidia H100
From $1.41 /GPU/hr Compare -
Nvidia H200
From $2.09 /GPU/hr Compare -
AMD MI300X
From $2.39 /GPU/hr Compare -
Nvidia RTX 4000 Ada
From $0.28 /GPU/hr Compare
Our data for Nvidia GH200 was last updated on Sept. 14, 2026, and for Nvidia RTX 4000 SFF Ada on Sept. 14, 2026.