Nvidia L40S
Cost-effective data center GPU for AI inference and media workloads.
- Arch
- Ada Lovelace
- Memory
- 48 GB GDDR6
- Bandwidth
- 864 GB/s
- Released
- Q3 2023
Price history
Weekly median price per GPU per hour
Aggregating historical prices...
At a glance Updated 3 minutes ago
- Cheapest in stock
- $0.38 /GPU/hr
- on-demand · 1x PCIe · Lium
- Median price (current)
- $1.50 /GPU/hr
- on-demand
- 90-day trend
- −3%
- median on-demand
- Coverage
- 35 providers
- 262 price points
Pricing & availability
How this list works
The two views
By provider shows one card per company, placed where its best offer ranked. By configuration lists every offer.
Order
What you can rent comes first: in stock, then waitlist, then not reported, then out of stock. Priced offers rank ahead of quote-only, and on-demand ahead of other billing types.
Within a group, five factors set the order:
- Location: datacenter proximity, blended with provider HQ.
- Price: hourly price, per GPU and in total.
- Billing type: reserved ahead of spot, spot ahead of quote-only.
- Specs: more VRAM, vCPUs and RAM.
- Provider diversity: a provider's repeat rows rank slightly lower, so one company can't take all the top spots.
Search
We match the provider, its country, GPU model, form factor, billing type, availability and instance name. Matching is partial and case-insensitive. Everyday words work too, so "interruptible" finds spot and "sold out" finds out of stock.
Transparency and funding
- Ads and sponsors: Paid placements sit at the top of the list and are always labeled as sponsored content. Sponsorship never influences the organic ranking itself.
- Affiliates: Affiliate links are marked. We may earn a commission if you click them, but commissions never affect the order.
- Prices: Shown in USD, converted at daily reference rates where a provider publishes in another currency. A month means 720 hours. How we estimate costs.
Packet·ai
In stock
USA
1 config
1x
Novita
In stock
USA
8 configs
1x-8x
EmpirioLabs AI
In stock
USA
4 configs
1x-8x
Runcrate
In stock
USA
1 config
1x
Massed Compute
In stock
USA
4 configs
1x-8x
Crusoe
In stock
USA
7 configs
1x-10x
Sesterce
In stock
France
19 configs
1x-10x
Koyeb
In stock
France
1 config
1x
UpCloud
In stock
Finland
22 configs
1x-3x
GPU.ai
In stock
UAE
4 configs
1x-8x
Runpod
In stock
USA
5 configs
1x-8x
Spheron
In stock
Singapore
24 configs
1x-4x
USA
1 config
1x
USA
4 configs
1x-8x
No providers match .
Heads up: A provider's own page may quote a different figure, for example on tax, region or a promotion. A monthly-only plan shows a derived hourly rate. Verify before provisioning. More on how we price.
What can the L40S run?
One L40S has 48 GB of VRAM. In practice, that's enough memory for roughly 68B parameters at 4-bit or 17B at 16-bit, assuming a 32K context. Below are some open-weight LLMs, with the estimated memory and GPUs each one needs.
Fits on 1
Single node ≤ 8
Multi-node
| Model | Memory (INT4 / FP4) | L40Ss needed | Cost /hr | Cost /mo |
|---|---|---|---|---|
Qwen3.8-27B
27B
|
18 GB
|
1
|
$1.50
|
$1,080
|
Gemma 4 31B
30.7B
|
22 GB
|
1
|
$1.50
|
$1,080
|
GPT-OSS-120B
117B · 5.1B active
|
67 GB
|
2
|
$3.00
|
$2,160
|
GLM-5.3-Flash
320B · 18B active
|
178 GB
|
8
|
$12.00
|
$8,640
|
MiniMax-M3
428B · 23B active
|
239 GB
|
8
|
$12.00
|
$8,640
|
DeepSeek V4.1 Flash
552B · 16B active
|
306 GB
|
8
|
$12.00
|
$8,640
|
Kimi K3
2.8T · 104B active
|
1,544 GB
|
36
|
–
|
–
|
Estimates based on the median on-demand rate. Memory is weights plus FP8 KV cache at 32K context per request (FP16/BF16 in the 16-bit column). GPU counts assume 90% of advertised VRAM is usable. No guarantee of runtime support, usable performance, or that a matching quantized build exists. How we estimate costs.
Technical Specifications
Nvidia L40S · Per GPU
| Compute · dense | |
|---|---|
| FP8 | 733 TFLOPS 1,466 with sparsity |
| FP16 / BF16 | 362.1 TFLOPS 733 with sparsity |
| INT8 | 733 TOPS 1,466 with sparsity |
| FP32 | 91.6 TFLOPS |
| Precision support | FP8FP16BF16TF32FP32INT4INT8 |
| Memory | |
|---|---|
| Capacity | 48 GB GDDR6 |
| Bandwidth | 864 GB/s |
| Bus width | 384-bit |
| ECC | Yes |
| Silicon | |
|---|---|
| Architecture | Ada Lovelace |
| Process | TSMC 4N |
| Transistors | 76.3 billion |
| Shader cores | 18,176 CUDA cores |
| Matrix cores | 568 Tensor cores |
| Compute units | 142 SMs |
| Fabric and host | |
|---|---|
| Host interface | PCIe 4.0 x16 |
| Power | |
|---|---|
| Board power | 350 W |
| Cooling | Passive |
Source: official Nvidia L40S datasheet.
Frequently Asked Questions
How much does the L40S cost per hour?
-
As of September 12, 2026, the median on-demand price is $1.50 per GPU per hour across 29 providers with a priced on-demand config.
Billing type Configs Median /GPU/hr Cheapest On-demand
136
$1.50
$0.38 (in stock, Lium)
Reserved
90
$1.11
$0.60 (12 mo)
Spot
36
$1.11
$0.74
Who has the cheapest L40S?
-
The cheapest verified in-stock on-demand L40S tracked by GetDeploying is $0.38 per GPU per hour from Lium.
How much does the L40S cost per month?
-
At 720 hours per month, one L40S costs an estimated $1,080 at the median on-demand price. Cheapest verified in stock: $274 per month on-demand, $641 spot.
Where can I rent an L40S?
-
GetDeploying currently tracks L40S configs from 35 providers. The cheapest verified in-stock on-demand configs come from Lium, Novita, EmpirioLabs AI and GPU.ai. See the full price comparison above for every provider and config.
Are L40S prices going up or down?
-
As of September 12, 2026, the median on-demand price has fallen about 3% over the past 90 days to $1.50 per GPU per hour, though it is about 20% above where it was a year ago.
How many L40S GPUs do I need?
-
One L40S runs models up to roughly 68B parameters at 4-bit quantization or 17B at 16-bit, assuming a 32K context. Larger models run across multiple GPUs: the model table above shows the estimated memory and GPU count for popular open-weight LLMs.
Why choose the L40S?
When is the L40S not a good fit?
-
PCIe-only with no NVLink, limiting multi-GPU training performance. GDDR6 memory bandwidth (864 GB/s) is significantly lower than HBM-based data center GPUs.
Alternatives to Nvidia L40S
Last updated