Nvidia L4

Nvidia L4

Low-power inference accelerator for cost-sensitive cloud deployments.

Compare vs other GPUs →
Aggregating historical prices...

Weekly median price per GPU per hour. Nvidia L4 price history (JSON).

At a glance

Hardware

Architecture
Ada Lovelace
Memory per GPU
24 GB GDDR6
Memory bandwidth
300 GB/s
Release date
Q1 2023

Market Updated 11 minutes ago

Cheapest in stock
$0.27 / GPU / hr
on-demand · 1x · GPU.ai
Median price
$0.90 / GPU / hr
on-demand
90-day trend
Flat
median on-demand
Coverage
18 providers
46 of 159 configs in stock

L4 Pricing and Availability

18 providers

How this list works

The two views

By provider shows one card per company, placed where its best offer ranked. By configuration lists every offer.

Order

What you can rent comes first: in stock, then waitlist, then not reported, then out of stock. Priced offers rank ahead of quote-only, and on-demand ahead of other billing types.

Within a group, five factors set the order:

  1. Location: datacenter proximity, blended with provider HQ.
  2. Price: hourly price, per GPU and in total.
  3. Billing type: reserved ahead of spot, spot ahead of quote-only.
  4. Specs: more VRAM, vCPUs and RAM.
  5. Provider diversity: a provider's repeat rows rank slightly lower, so one company can't take all the top spots.

Search

We match the provider, its country, GPU model, form factor, billing type, availability and instance name. Matching is partial and case-insensitive. Everyday words work too, so "interruptible" finds spot and "sold out" finds out of stock.

Transparency and funding

  • Ads and sponsors: Paid placements sit at the top of the list and are always labeled as sponsored content. Sponsorship never influences the organic ranking itself.
  • Affiliates: Affiliate links are marked. We may earn a commission if you click them, but commissions never affect the order.
  • Prices: Shown in USD, converted at daily reference rates where a provider publishes in another currency. A month means 720 hours. How we estimate costs.
Runpod logo

Runpod

Our sponsor

United States of America flag USA 2 configs 1x-8x

On-Demand from $0.49 Reserved on request
Pricing On request Reservation Visit website
Vast.ai logo

Vast.ai

In stock

United States of America flag USA 13 configs 1x-5x

On-Demand from $0.31 Reserved from $0.27 Spot from $0.14
From $0.31 / GPU / hr On-Demand Visit website
Runcrate logo

Runcrate

In stock

United States of America flag USA 1 config 1x

On-Demand from $1.05
From $1.05 / GPU / hr On-Demand PCIe Visit website
UpCloud logo

UpCloud

In stock

Finland flag Finland 22 configs 1x-3x

On-Demand from $0.69 Spot from $0.68
From $0.69 / GPU / hr On-Demand Visit website
Scaleway logo

Scaleway

In stock

France flag France 4 configs 1x-8x

On-Demand from $0.92
From $0.92 / GPU / hr On-Demand Visit website
Sesterce logo

Sesterce

In stock

France flag France 4 configs 1x-8x

On-Demand from $1.04
From $1.04 / GPU / hr On-Demand Visit website
GPU.ai logo

GPU.ai

In stock

United Arab Emirates flag UAE 2 configs 1x-2x

On-Demand from $0.27
From $0.27 / GPU / hr On-Demand Visit website
Hexabyte logo

Hexabyte

Waitlist

Sweden flag Sweden 4 configs 1x-2x

On-Demand from $0.42
From $0.42 / GPU / hr On-Demand Visit website
Koyeb logo

Koyeb

Waitlist

France flag France 1 config 1x

On-Demand from $0.70
From $0.70 / GPU / hr On-Demand Visit website
Cerebrium logo

United States of America flag USA 4 configs 1x-8x

On-Demand from $0.80
From $0.80 / GPU / hr On-Demand Visit website
Google Cloud logo

United States of America flag USA 32 configs 1x-8x

On-Demand from $0.70 Reserved from $0.32 Spot from $0.34
From $0.70 / GPU / hr On-Demand Visit website
Hugging Face logo

United States of America flag USA 2 configs 1x-4x

On-Demand from $0.80
From $0.80 / GPU / hr On-Demand Visit website
Amazon Web Services logo

AWS

United States of America flag USA 30 configs 1x-8x

On-Demand from $0.80 Reserved from $0.37
From $0.80 / GPU / hr On-Demand Visit website
OVHcloud logo

OVH

France flag France 3 configs 1x-4x

On-Demand from $1.00
From $1.00 / GPU / hr On-Demand Visit website
Leaseweb logo

Netherlands flag Netherlands 18 configs 1x-4x

On-Demand from $0.45 Reserved from $0.42
From $0.45 / GPU / hr On-Demand Visit website
Elastx logo

Sweden flag Sweden 1 config 1x

On-Demand from $1.03
From $1.03 / GPU / hr On-Demand Visit website
Utho logo

India flag India 1 config 1x

Reserved from $0.33
From $0.33 / GPU / hr Reserved (36mo) Visit website
AceCloud logo

India flag India 15 configs 1x-4x

Reserved from $0.60
From $0.60 / GPU / hr Reserved (12mo) Visit website

Heads up: A provider's own page may quote a different figure, for example on tax, region or a promotion. A monthly-only plan shows a derived hourly rate. Verify before provisioning. More on how we price.

What size AI models can the L4 run?

One L4 has 24 GB of VRAM. In practice, that's enough memory for roughly 28B parameters at 4-bit or 6B at 16-bit, assuming a 32K context. Below are some open-weight LLMs, with the estimated memory and GPUs each one needs.

Model Parameters 4-bitINT4 / FP4 8-bitFP8 / INT8 16-bitFP16 / BF16
Alibaba Cloud logo Qwen3.8-27B
27B
1 GPU 18 GB VRAM · $648/mo
2 GPUs 30 GB VRAM · $1,296/mo
4 GPUs 58 GB VRAM · $2,592/mo
Google Cloud logo Gemma 4 31B
30.7B
1 GPU 22 GB VRAM · $648/mo
2 GPUs 35 GB VRAM · $1,296/mo
4 GPUs 69 GB VRAM · $2,592/mo
OpenAI logo GPT-OSS-120B
117B 5.1B active
4 GPUs 67 GB VRAM · $2,592/mo
8 GPUs 120 GB VRAM · $5,184/mo
11 GPUs 237 GB VRAM
DeepSeek logo DeepSeek V4 Flash
284B 13B active
8 GPUs 160 GB VRAM · $5,184/mo
14 GPUs 287 GB VRAM
27 GPUs 573 GB VRAM
Z.AI logo GLM-5.3-Flash
320B 18B active
9 GPUs 178 GB VRAM
15 GPUs 322 GB VRAM
30 GPUs 642 GB VRAM
MiniMax logo MiniMax-M3
428B 23B active
12 GPUs 239 GB VRAM
20 GPUs 432 GB VRAM
40 GPUs 862 GB VRAM
Moonshot AI logo Kimi K3
2.8T 104B active
72 GPUs 1,544 GB VRAM
130 GPUs 2,804 GB VRAM
260 GPUs 5,605 GB VRAM

Estimates based on the median on-demand rate. Memory is weights plus FP8 KV cache at 32K context per request (FP16/BF16 in the 16-bit column). GPU counts assume 90% of advertised VRAM is usable. No guarantee of runtime support, usable performance, or that a matching quantized build exists. How we estimate costs.

Technical Specifications

Nvidia L4 · Per GPU

Compute · dense
FP8 242 TFLOPS 485 with sparsity
FP16 / BF16 121 TFLOPS 242 with sparsity
INT8 242 TOPS 485 with sparsity
FP32 30.3 TFLOPS
Precision support FP8FP16BF16TF32FP32INT4INT8
Memory
Capacity 24 GB GDDR6
Bandwidth 300 GB/s
Bus width 192-bit
ECC Yes
Silicon
Architecture Ada Lovelace
Process TSMC 4N
Shader cores 7,424 CUDA cores
Matrix cores 232 Tensor cores
Compute units 58 SMs
Fabric and host
Host interface PCIe 4.0 x16
Power
Board power 72 W
Cooling Passive

Source: official Nvidia L4 datasheet.

Frequently Asked Questions

How much does the L4 cost per hour?

As of September 8, 2026, the median on-demand price is $0.90 per GPU per hour across 15 providers with a priced on-demand config.

Billing type Configs Median / GPU / hr Cheapest
On-demand 72 $0.90 $0.27 (in stock, GPU.ai)
Reserved 63 $0.52 $0.27 (3 mo, in stock, Vast.ai)
Spot 24 $0.48 $0.14 (in stock, Vast.ai)

Who has the cheapest L4?

As of September 8, 2026, the cheapest verified in-stock on-demand L4 tracked by GetDeploying is $0.27 per GPU per hour from GPU.ai. Cheapest verified in stock on other billing types: reserved $0.27 (3 mo) and spot $0.14, both from Vast.ai.

How much does the L4 cost per month?

As of September 8, 2026, at 720 hours per month, one L4 costs an estimated $648 at the median on-demand price. Cheapest verified in stock: $194 per month on-demand, $194 reserved (3 mo), $101 spot.

Where can I rent an L4?

GetDeploying currently tracks L4 configs from 18 providers. The cheapest verified in-stock on-demand configs come from GPU.ai, Vast.ai, UpCloud and Scaleway. See the full price comparison above for every provider and config.

Are L4 prices going up or down?

As of September 8, 2026, the median on-demand price has been flat over the past 90 days, at about $0.90 per GPU per hour, though it is about 7% below where it was a year ago.

How many L4 GPUs do I need?

One L4 runs models up to roughly 28B parameters at 4-bit quantization or 6B at 16-bit, assuming a 32K context. Larger models run across multiple GPUs: the model table above shows the estimated memory and GPU count for popular open-weight LLMs.

Why choose the L4?

24GB GDDR6 in a low-power 72W form factor. FP8 support for efficient inference. Excellent performance-per-watt for deploying AI models at scale in cost-sensitive environments.

When is the L4 not a good fit?

Limited VRAM caps model sizes at ~13B parameters (FP16). Built for inference, not training. Low memory bandwidth (300 GB/s) may limit throughput on memory-bound workloads.

Alternatives to Nvidia L4

Last updated