Two Nvidia data center GPUs, one Grace Hopper and one Turing: 96 GB HBM3 against 16 GB GDDR6, 13x the memory bandwidth on the GH200, and NVLink 900 GB/s on the GH200 where the T4 is PCIe only.
At a glance
Memory
- GH200
- 96 GB
- T4
- 16 GB
6x more on GH200
Memory bandwidth
- GH200
- 4,000 GB/s
- T4
- 300 GB/s
13x higher on GH200
Cheapest on-demand
- GH200
- $2.29 /GPU/hr
- T4
- $0.20 /GPU/hr
11x more expensive on GH200
Price comparison
Median price per GPU per hour by billing type, with the cheapest listing under it.
| Billing | GH200 | T4 | Difference |
|---|---|---|---|
| On-demand | $2.52 /GPU/hr from $2.29 | $0.69 /GPU/hr from $0.20 | 3.6x more expensive on GH200 |
| Reserved | No reserved listings | $0.43 /GPU/hr from $0.20 (36 mo) | |
| Spot | Sold out | -- /GPU/hr from $0.10 |
Heads up: A provider's own page may quote a different figure, for example on tax, region or a promotion. A monthly-only plan shows a derived hourly rate. Medians are across providers, one vote each, so a large catalog does not outweigh a small one. No median for spot on the T4: we only show one when at least 3 providers list the GPU on that billing type. Verify before provisioning. More on how we price.
Price history
GH200 vs T4 price history
Weekly median on-demand price per GPU per hour
Specs comparison
| Spec | GH200 | T4 | Difference |
|---|---|---|---|
| Memory | |||
| Capacity | 96 GB HBM3 | 16 GB GDDR6 | 6x more on GH200 |
| Bandwidth | 4,000 GB/s | 300 GB/s | 13x higher on GH200 |
| Bus width | 256-bit | ||
| Compute · dense | |||
| FP8 | 1,979 TFLOPS | Not supported | GH200 only |
| FP16 / BF16 | 989.5 TFLOPS | 65 TFLOPS | 15x higher on GH200 |
| INT8 | 1,979 TOPS | 130 TOPS | 15x higher on GH200 |
| FP32 | 67 TFLOPS | 8.1 TFLOPS | 8.3x higher on GH200 |
| FP64 | 34 TFLOPS | Not supported | GH200 only |
| Platform | |||
| Interconnect | NVLink 900 GB/s | PCIe only | NVLink on GH200 only |
| Released | Q2 2023 | Q3 2018 | 5 years newer on GH200 |
| Precision | |||
| Supported formats | FP8FP16BF16TF32FP32FP64INT8 | FP16FP32INT4INT8 | |
Compute: Vendor peak figures, dense and per GPU. Not measured throughput.
Source: GH200 datasheet and T4 datasheet.
Where to rent them
Providers listing these GPUs, those with both first, so you can switch without moving clouds.
| Provider | GH200 /GPU/hr | T4 /GPU/hr |
|---|---|---|
Lambda Labs
|
On-Demand $2.29 | -- |
Sesterce
|
On-Demand $2.52 | -- |
CoreWeave
|
On-Demand $6.50 | -- |
Vultr
|
Spot $1.99 | -- |
Zenlayer
|
-- | On-Demand $0.56 |
Theta EdgeCloud
|
-- | On-Demand $0.20 |
Hugging Face
|
-- | On-Demand $0.40 |
Google Cloud
|
-- | On-Demand $0.42 |
AWS
|
-- | On-Demand $0.53 |
Azure
|
-- | On-Demand $0.53 |
Cerebrium
|
-- | On-Demand $0.59 |
Replicate
|
-- | On-Demand $0.81 |
4 providers list the GH200 and 10 the T4. Every listing is on the GH200 page and the T4 page.
Similar GPUs
Other comparisons in the same class.
Our data for Nvidia GH200 was last updated on Sept. 7, 2026, and for Nvidia T4 on Sept. 7, 2026.