Nvidia L40 vs Nvidia RTX PRO 6000D

The RTX PRO 6000D is newer, with 75% more memory and 81% more bandwidth. The L40 is cheaper right now.

At a glance

Memory

75% more on RTX PRO 6000D

L40: 48 GB

RTX PRO 6000D: 84 GB

Memory bandwidth

81% higher on RTX PRO 6000D

L40: 864 GB/s

RTX PRO 6000D: 1,568 GB/s

Cheapest on-demand

53% cheaper on L40

L40: $0.46 /GPU/hr

RTX PRO 6000D: $0.97 /GPU/hr

Price comparison

Median price per GPU per hour by billing type, with the cheapest listing under it.

Billing	L40	RTX PRO 6000D
On-demand	$1.05 /GPU/hr from $0.46	-- /GPU/hr from $0.97
Reserved	-- /GPU/hr from $0.70	-- /GPU/hr from $1.20 (6 mo)
Spot	$0.78 /GPU/hr from $0.40	-- /GPU/hr from $0.54

Heads up: A provider's own page may quote a different figure, for example on tax, region or a promotion. A monthly-only plan shows a derived hourly rate. Medians are across providers, one vote each, so a large catalog does not outweigh a small one. No median for reserved on the L40 and on-demand, reserved and spot on the RTX PRO 6000D: we only show one when at least 3 providers list the GPU on that billing type. Verify before provisioning. More on how we price.

Price history

L40 vs RTX PRO 6000D price history

Weekly median on-demand price per GPU per hour

Last 12 months

Aggregating historical prices...

Specs comparison

Spec	L40	RTX PRO 6000D	Difference
Memory
Capacity	48 GB GDDR6	84 GB GDDR7	75% more on RTX PRO 6000D
Bandwidth	864 GB/s	1,568 GB/s	81% higher on RTX PRO 6000D
Bus width	384-bit	448-bit	17% wider on RTX PRO 6000D
Compute · dense
FP4	Not supported	1,553 TFLOPS	RTX PRO 6000D only
FP8	362 TFLOPS	776 TFLOPS	2.1x higher on RTX PRO 6000D
FP16 / BF16	181.1 TFLOPS	388 TFLOPS	2.1x higher on RTX PRO 6000D
INT8	362 TOPS	776 TOPS	2.1x higher on RTX PRO 6000D
FP32	90.5 TFLOPS	97 TFLOPS	7% higher on RTX PRO 6000D
Platform
Interconnect	PCIe only	PCIe only
Board power	300 W	400 W	33% higher on RTX PRO 6000D
Released	Q4 2022	Q3 2025	3 years newer on RTX PRO 6000D
Precision
Supported formats	FP8FP16BF16TF32FP32INT4INT8	FP4FP8FP16BF16TF32FP32INT8

Compute: Vendor peak figures, dense and per GPU. Not measured throughput.

Source: L40 datasheet .

Where to rent them

Providers that rent these GPUs, with each one's cheapest rate. Providers that rent both are listed first.

Provider	L40	RTX PRO 6000D
Vast.ai USA	$0.46 /GPU/hr On-demand	$1.07 /GPU/hr On-demand
GPU.ai UAE	$0.78 /GPU/hr On-demand	--
Thunder Compute USA	$0.79 /GPU/hr On-demand	--
Runpod USA	$0.82 /GPU/hr On-demand	--
Massed Compute USA	$0.86 /GPU/hr On-demand	--
Hyperstack UK	$1.00 /GPU/hr On-demand	--
Oblivus USA	$1.05 /GPU/hr On-demand PCIe	--
Spheron Singapore	$1.06 /GPU/hr On-demand PCIe	--
GPUhub Singapore	--	$0.97 /GPU/hr On-demand