Nvidia L4

Nvidia L4

Low-power inference accelerator for cost-sensitive cloud deployments.

Compare vs other GPUs →
Aggregating historical prices...

Key Specifications

Architecture
Ada Lovelace
Memory
24GB GDDR6
Memory Bandwidth
300 GB/s
Release date
Q1 2023

Compare Cloud Provider Prices

Barriers to entry are low here. 14 cloud providers list the L4 with prices starting at just $0.13/hr per GPU (spot instance), making it accessible for testing without a large commitment.

of shown

Default ranking

Our algorithm weighs five factors to find the most relevant matches for you:

  1. Price: We blend total hourly price with price-per-GPU to balance affordability and value.
  2. Specs: We favor offers with higher CPU, RAM, and GPU Memory.
  3. Billing: We favor on-demand billing for simplicity and flexibility over spot instances, reservations, and custom quotes.
  4. Location: We blend both datacenter proximity and provider HQ location. Datacenter location matters for latency, while HQ location matters for compliance and support.
  5. Provider diversity: Each time a provider appears in the list, their subsequent offerings are ranked a little lower, so one provider's offerings don't crowd out the top positions.

Sorting and filtering

Click any column header to sort by that column. Use the filters above the table to narrow results by billing type, GPU count, vCPUs, or RAM. Custom sorting resets the default relevance ranking.

Transparency and funding

Ads and sponsors: Any paid placements are fixed at the top and clearly labeled as sponsored content.

Affiliates: Any affiliate links will be indicated to you as well. We may earn a commission if you click them, but this never influences the ranking order.

Provider GPUs Total VRAM vCPUs RAM Billing $/GPU/h Total/h Availability
Google Cloud logo Google Cloud 1x L4 1x L4 24GB (g2-standard-4) 24GB 4 16GB On-Demand Pay-as-you-go pricing. No term commitments. $0.71 $0.71 Available View
Amazon Web Services logo AWS 1x L4 1x L4 24GB (g6.xlarge) 24GB 4 16GB On-Demand Pay-as-you-go pricing. No term commitments. $2.30 $2.30 Available View
Google Cloud logo Google Cloud 1x L4 1x L4 24GB (g2-standard-8) 24GB 8 32GB On-Demand Pay-as-you-go pricing. No term commitments. $0.86 $0.86 Available View
UpCloud logo UpCloud 1x L4 1x L4 24GB 24GB 8 64GB On-Demand Pay-as-you-go pricing. No term commitments. $0.66 $0.66 Unknown View
Koyeb logo Koyeb 1x L4 1x L4 24GB (L4) 24GB 6 32GB On-Demand Pay-as-you-go pricing. No term commitments. $0.70 $0.70 Unknown View
Leaseweb logo Leaseweb 1x L4 1x L4 24GB (LSW.GR6.4XLARGE) 24GB 16 128GB On-Demand Memory-optimized. $0.85 $0.85 Unknown View
OVHcloud logo OVH 1x L4 1x L4 24GB (l4-90) 24GB 22 90GB On-Demand Pay-as-you-go pricing. No term commitments. $1.00 $1.00 Unknown View
Sesterce logo Sesterce 1x L4 1x L4 24GB 24GB 8 48GB On-Demand Pay-as-you-go pricing. No term commitments. $1.04 $1.04 Available View
Amazon Web Services logo AWS 1x L4 1x L4 24GB (g6.8xlarge) 24GB 32 128GB On-Demand Pay-as-you-go pricing. No term commitments. $2.56 $2.56 Available View
Google Cloud logo Google Cloud 1x L4 1x L4 24GB (g2-standard-12) 24GB 12 48GB On-Demand Pay-as-you-go pricing. No term commitments. $1.01 $1.01 Available View
UpCloud logo UpCloud 1x L4 1x L4 24GB 24GB 12 128GB On-Demand Pay-as-you-go pricing. No term commitments. $0.80 $0.80 Unknown View
Leaseweb logo Leaseweb 1x L4 1x L4 24GB (LSW.G6.XLARGE) 24GB 4 16GB On-Demand Pay-as-you-go pricing. No term commitments. $0.70 $0.70 Unknown View
Hexabyte logo Hexabyte 1x L4 1x L4 24GB 24GB 16 64GB On-Demand Pay-as-you-go pricing. No term commitments. $0.50 $0.50 Unknown View
Scaleway logo Scaleway 1x L4 1x L4 24GB 24GB 8 48GB On-Demand Pay-as-you-go pricing. No term commitments. $0.90 $0.90 Unknown View
Elastx logo Elastx 1x L4 1x L4 24GB (g2-c6-m90-d800-g24) 24GB 6 90GB On-Demand Pay-as-you-go pricing. No term commitments. $0.94 $0.94 Unknown View
OVHcloud logo OVH 2x L4 2x L4 24GB (l4-180) 48GB 45 180GB On-Demand Pay-as-you-go pricing. No term commitments. $1.00 $2.00 Unknown View
Sesterce logo Sesterce 2x L4 2x L4 24GB 48GB 16 96GB On-Demand Pay-as-you-go pricing. No term commitments. $1.04 $2.09 Available View
Amazon Web Services logo AWS 1x L4 1x L4 24GB (g6.2xlarge) 24GB 8 32GB On-Demand Pay-as-you-go pricing. No term commitments. $3.98 $3.98 Available View
Google Cloud logo Google Cloud 1x L4 1x L4 24GB (g2-standard-16) 24GB 16 64GB On-Demand Pay-as-you-go pricing. No term commitments. $1.16 $1.16 Available View
No offerings matching your filters.

Heads up: We do our best to keep these specs & prices accurate. However, cloud costs may fluctuate based on region, usage, and other factors not listed here. These are estimates based on common setups and are for informational purposes only. Always verify current rates & exact specs with the provider before provisioning.

Frequently Asked Questions

Why choose the L4?

24GB GDDR6 in a low-power 72W form factor. FP8 support for efficient inference. Excellent performance-per-watt for deploying AI models at scale in cost-sensitive environments.

When is the L4 not a good fit?

Limited VRAM caps model sizes at ~13B parameters (FP16). Built for inference, not training. Low memory bandwidth (300 GB/s) may limit throughput on memory-bound workloads.

Are L4 prices going up or down?

On-demand pricing has increased by about 15% since June 2025, from $1.16 to $1.33/hr per GPU.

What size AI models can the L4 run?

With 24GB of VRAM, the L4 can typically run 7B to 13B models in FP16, or larger models in 4-bit quantized form.

How much VRAM does the L4 have?

The L4 has 24GB of VRAM. Multi-GPU setups increase total memory, but that memory is not automatically pooled across GPUs.

What is the L4's memory bandwidth?

The L4 has 300 GB/s of memory bandwidth. Higher bandwidth helps with faster data transfer between GPU memory and compute cores.

What data types does the L4 support?

The L4 supports 6 precision formats. Training: BF16, FP16, TF32, FP32. Inference: FP8, INT8.

Does the L4 support NVLink?

No. The L4 is a PCIe-only GPU with no NVLink, so it is better suited to single-GPU inference and smaller-scale workloads than large distributed training jobs.

How much does the L4 cost per hour?

L4 pricing currently ranges from $0.13/hr to $11.08/hr per GPU, depending on the provider, instance type, and billing model.

How much does the L4 cost per month?

At 720 hours per month, one L4 can cost between $96.52 to $7,975.30 per month, depending on the provider. Reserved and spot pricing can lower that further.

Which cloud providers offer the L4?

The L4 is available from 14 cloud providers, including Amazon Web Services, UpCloud, Leaseweb. Pricing and availability vary by region and billing model.

Can I rent the L4 in the cloud?

Yes. We currently track 110 L4 listings across 14 cloud providers:

Billing type Listings Avg $/GPU/hr
On-demand 62 $1.36/hr
Reserved 35 $2.17/hr
Spot 13 $0.26/hr

Technical Specifications

FP32 30.3 TFLOPs
TF32 Tensor Core 120 TFLOPs
FP16 Tensor Core 242 TFLOPs
BFLOAT16 Tensor Core 242 TFLOPs
FP8 Tensor Core 485 TFLOPs
INT8 Tensor Core 485 TOPs
GPU Memory 24GB
GPU Memory Bandwidth 300 GB/s
NVENC, NVDEC, JPEG Decoders 2, 4, 4
Max Thermal Design Power (TDP) 72W
Form Factor 1-slot low-profile, PCIe
Interconnect PCIe Gen4 x16 64GB/s
Server Options Partner and NVIDIA-Certified Systems with 1‒8 GPUs

Source: official Nvidia L4 datasheet.

Alternatives to Nvidia L4

Last updated