The GH200 is newer, with 6x the memory and 13x the bandwidth. The T4 is cheaper right now.
At a glance
Memory
6x more on GH200
- GH200
- 96 GB
- T4
- 16 GB
Memory bandwidth
13x higher on GH200
- GH200
- 4,000 GB/s
- T4
- 300 GB/s
Cheapest on-demand
95% cheaper on T4
- GH200
- $3.87 /GPU/hr
- T4
- $0.20 /GPU/hr
Price comparison
Median price per GPU per hour by billing type, with the cheapest listing under it.
| Billing | GH200 | T4 | Difference |
|---|---|---|---|
| On-demand | -- /GPU/hr from $3.87 | $0.69 /GPU/hr from $0.20 | |
| Reserved | No reserved listings | $0.43 /GPU/hr from $0.20 (36 mo) | |
| Spot | Sold out | -- /GPU/hr from $0.15 |
Heads up: A provider's own page may quote a different figure, for example on tax, region or a promotion. A monthly-only plan shows a derived hourly rate. Medians are across providers, one vote each, so a large catalog does not outweigh a small one. No median for on-demand on the GH200 and spot on the T4: we only show one when at least 3 providers list the GPU on that billing type. Verify before provisioning. More on how we price.
Price history
GH200 vs T4 price history
Weekly median on-demand price per GPU per hour
Specs comparison
| Spec | GH200 | T4 | Difference |
|---|---|---|---|
| Memory | |||
| Capacity | 96 GB HBM3 | 16 GB GDDR6 | 6x more on GH200 |
| Bandwidth | 4,000 GB/s | 300 GB/s | 13x higher on GH200 |
| Bus width | 256-bit | ||
| Compute · dense | |||
| FP8 | 1,979 TFLOPS | Not supported | GH200 only |
| FP16 / BF16 | 989.5 TFLOPS | 65 TFLOPS | 15x higher on GH200 |
| INT8 | 1,979 TOPS | 130 TOPS | 15x higher on GH200 |
| FP32 | 67 TFLOPS | 8.1 TFLOPS | 8.3x higher on GH200 |
| FP64 | 34 TFLOPS | Not supported | GH200 only |
| Platform | |||
| Interconnect | NVLink 900 GB/s | PCIe only | NVLink on GH200 only |
| Released | Q2 2023 | Q3 2018 | 5 years newer on GH200 |
| Precision | |||
| Supported formats | FP8FP16BF16TF32FP32FP64INT8 | FP16FP32INT4INT8 | |
Compute: Vendor peak figures, dense and per GPU. Not measured throughput.
Source: GH200 datasheet and T4 datasheet.
Where to rent them
Providers that rent these GPUs, with each one's cheapest rate. No provider we track offers both right now.
| Provider | GH200 | T4 |
|---|---|---|
Denvr
Canada
|
$3.87 /GPU/hr On-demand | -- |
CoreWeave
USA
|
$6.50 /GPU/hr On-demand | -- |
Lambda Labs
USA
|
$2.29 /GPU/hr On-demand | -- |
Sesterce
France
|
$2.52 /GPU/hr On-demand | -- |
Vultr
USA
|
$1.99 /GPU/hr Spot | -- |
Zenlayer
USA
|
-- | $0.56 /GPU/hr On-demand PCIe |
Theta EdgeCloud
Distributed
|
-- | $0.20 /GPU/hr On-demand |
Hugging Face
USA
|
-- | $0.40 /GPU/hr On-demand |
Google Cloud
USA
|
-- | $0.42 /GPU/hr On-demand |
AWS
USA
|
-- | $0.53 /GPU/hr On-demand |
Azure
USA
|
-- | $0.53 /GPU/hr On-demand |
Cerebrium
USA
|
-- | $0.59 /GPU/hr On-demand |
Replicate
USA
|
-- | $0.81 /GPU/hr On-demand |
5 providers list the GH200 and 10 the T4. Every listing is on the GH200 page and the T4 page.
Similar GPUs
Other comparisons in the same class.
Our data for Nvidia GH200 was last updated on Sept. 14, 2026, and for Nvidia T4 on Sept. 14, 2026.