Nvidia L4 vs Nvidia V100

The V100 has 33% more memory and 3x the bandwidth.

At a glance

Memory

33% more on V100

L4: 24 GB

V100: 32 GB

Memory bandwidth

3x higher on V100

L4: 300 GB/s

V100: 900 GB/s

Cheapest on-demand

63% cheaper on V100

L4: $0.33 /GPU/hr

V100: $0.12 /GPU/hr

Price comparison

Median price per GPU per hour by billing type, with the cheapest listing under it.

Billing	L4	V100	Difference
On-demand	$0.88 /GPU/hr from $0.33	$0.97 /GPU/hr from $0.12	10% cheaper on L4
Reserved	$0.51 /GPU/hr from $0.32 (36 mo)	$1.51 /GPU/hr from $0.12 (1 mo)	67% cheaper on L4
Spot	$0.41 /GPU/hr from $0.20	$0.40 /GPU/hr from $0.07	Within 5%

Heads up: A provider's own page may quote a different figure, for example on tax, region or a promotion. A monthly-only plan shows a derived hourly rate. Medians are across providers, one vote each, so a large catalog does not outweigh a small one. Verify before provisioning. More on how we price.

Price history

L4 vs V100 price history

Weekly median on-demand price per GPU per hour

Last 12 months

Aggregating historical prices...

Specs comparison

Spec	L4	V100	Difference
Memory
Capacity	24 GB GDDR6	32 GB HBM2	33% more on V100
Bandwidth	300 GB/s	900 GB/s	3x higher on V100
Bus width	192-bit	4,096-bit	21x wider on V100
Compute · dense
FP8	242 TFLOPS	Not supported	L4 only
FP16 / BF16	121 TFLOPS	125 TFLOPS	Within 5%
INT8	242 TOPS
FP32	30.3 TFLOPS	15.7 TFLOPS	93% higher on L4
FP64	Not supported	7.8 TFLOPS	V100 only
Platform
Interconnect	PCIe only	NVLink 300 GB/s	NVLink on V100 only
Board power	72 W	300 W	4.2x higher on V100
Released	Q1 2023	Q2 2017	6 years newer on L4
Precision
Supported formats	FP8FP16BF16TF32FP32INT4INT8	FP16FP32FP64INT8

Figures are for each model's headline configuration. Where a form factor carries a different number, it is named under the figure.

Compute: Vendor peak figures, dense and per GPU. Not measured throughput.

Source: L4 datasheet and V100 datasheet.

Where to rent them

Providers that rent these GPUs, with each one's cheapest rate. Providers that rent both are listed first.

Provider	L4	V100
Vast.ai USA	$0.33 /GPU/hr On-demand	$0.12 /GPU/hr On-demand
GPU.ai UAE	$0.33 /GPU/hr On-demand	$0.12 /GPU/hr On-demand
Runpod USA	$0.49 /GPU/hr On-demand	$0.19 /GPU/hr On-demand PCIe
Sesterce France	$1.04 /GPU/hr On-demand	$2.57 /GPU/hr On-demand
Runcrate USA	$1.23 /GPU/hr On-demand PCIe	$3.04 /GPU/hr On-demand NVL
Jarvislabs India	$0.44 /GPU/hr On-demand	--
UpCloud Finland	$0.69 /GPU/hr On-demand	--
Scaleway France	$0.89 /GPU/hr On-demand	--
HyperAI Hong Kong	--	$0.14 /GPU/hr On-demand
Geodd USA	--	$0.16 /GPU/hr On-demand
TensorDock Distributed	--	$0.28 /GPU/hr On-demand SXM