Two Nvidia data center GPUs, one Grace Hopper and one Ada Lovelace: 96 GB HBM3 against 48 GB GDDR6, 4.6x the memory bandwidth on the GH200, and NVLink 900 GB/s on the GH200 where the L40S is PCIe only.
At a glance
Updated 6 minutes ago- Memory
- 96 GB
- HBM3
- Memory bandwidth
- 4.00 TB/s
- From
- $2.52 /GPU/hr
- 4 providers
- Memory
- 48 GB
- GDDR6
- Memory bandwidth
- 864 GB/s
- From
- $0.55 /GPU/hr
- 34 providers
Price comparison
Cheapest listed price per GPU per hour by billing type, and the median across providers.
| Billing | GH200 | L40S | Difference |
|---|---|---|---|
| On-demand | $2.52 | $0.55 | 4.6x more expensive on GH200 |
| Spot | No spot listings | $0.74 | |
| Reserved | No reserved listings | $0.60 | |
| Median | $4.51 | $1.60 | 2.8x more expensive on GH200 |
Median: Median across providers, one vote each, so a large catalog does not outweigh a small one.
Price history
GH200 vs L40S price history
Weekly median on-demand price per GPU per hour
Specs comparison
| Spec | GH200 | L40S | Difference |
|---|---|---|---|
| Memory | |||
| Capacity | 96 GB HBM3 | 48 GB GDDR6 | 2x more on GH200 |
| Bandwidth | 4,000 GB/s | 864 GB/s | 4.6x higher on GH200 |
| Bus width | 384-bit | ||
| Compute · dense | |||
| FP8 | 1,979 TFLOPS | 733 TFLOPS | 2.7x higher on GH200 |
| FP16 / BF16 | 989.5 TFLOPS | 362.1 TFLOPS | 2.7x higher on GH200 |
| INT8 | 1,979 TOPS | 733 TOPS | 2.7x higher on GH200 |
| FP32 | 67 TFLOPS | 91.6 TFLOPS | 1.4x higher on L40S |
| FP64 | 34 TFLOPS | Not supported | GH200 only |
| Platform | |||
| Interconnect | NVLink 900 GB/s | PCIe only | NVLink on GH200 only |
| Released | Q2 2023 | Q3 2023 | |
| Precision | |||
| Supported formats | FP8FP16BF16TF32FP32FP64INT8 | FP8FP16BF16TF32FP32INT4INT8 | |
Compute: Vendor peak figures, dense and per GPU. Not measured throughput.
Source: GH200 datasheet and L40S datasheet.
Where to rent them
Providers listing these GPUs, those with both first, so you can switch without moving clouds.
| Provider | GH200 /GPU/hr | L40S /GPU/hr |
|---|---|---|
Sesterce
|
On-Demand $2.52 | On-Demand $0.97 |
CoreWeave
|
On-Demand $6.50 | -- |
Lambda Labs
|
On-Demand $2.29 | -- |
Vultr
|
Spot $1.99 | -- |
Novita
|
-- | On-Demand $0.55 |
GPU.ai
|
-- | On-Demand $0.80 |
Packet·ai
|
-- | On-Demand $0.92 |
Massed Compute
|
-- | On-Demand $0.97 |
Runcrate
|
-- | On-Demand $0.97 |
UpCloud
|
-- | On-Demand $1.19 |
Koyeb
|
-- | On-Demand $1.20 |
4 providers list the GH200 and 34 the L40S. Every listing is on the GH200 page and the L40S page.
Similar GPUs
Other comparisons in the same class.
Our data for Nvidia GH200 was last updated on Sept. 7, 2026, and for Nvidia L40S on Sept. 7, 2026.