Nvidia L40S
Compare prices for Nvidia L40S across cloud providers
Feb. 24, 2025 (updated)
The Nvidia L40S is designed for high-performance AI and HPC workloads, offering improved scalability and energy efficiency. Nvidia emphasizes its capabilities for enterprise-scale training and inference tasks.
Provider | GPUs | VRAM | vCPUs | RAM | Price/h | |
---|---|---|---|---|---|---|
![]() |
1x L40S | 48GB | 12 | 62GB | $0.86 | Source |
![]() |
1x L40S | 48GB | 8 | 94GB | $0.99 | Source |
![]() |
2x L40S | 96GB | 28 | 58GB | $1.00 | Source |
![]() |
1x L40S | 48GB | 28 | 58GB | $1.00 | Launch |
![]() |
1x L40S | 48GB | 22 | 128GB | $1.10 | Launch |
![]() |
1x L40S | 48GB | 20 | 60GB | $1.10 | Source |
![]() |
1x L40S | 48GB | -- | -- | $1.25 | Source |
![]() |
1x L40S | 48GB | 32 | 48GB | $1.25 | Source |
![]() |
1x L40S | 48GB | 8 | 147GB | $1.45 | Launch |
![]() |
1x L40S | 48GB | 8 | 96GB | $1.52 | Launch |
![]() |
1x L40S | 48GB | 8 | 32GB | $1.58 | Source |
![]() |
1x L40S | 48GB | 12 | 48GB | $1.75 | Launch |
![]() |
1x L40S | 48GB | 8 | 64GB | $1.79 | Source |
![]() |
1x L40S | 48GB | 15 | 90GB | $1.80 | Source |
![]() |
1x L40S | 48GB | 30 | 92GB | $2.00 | Source |
![]() |
1x L40S | 48GB | 16 | 240GB | $2.23 | Source |
![]() |
2x L40S | 96GB | 16 | 192GB | $3.05 | Source |
![]() |
2x L40S | 96GB | 16 | 128GB | $3.57 | Source |
![]() |
2x L40S | 96GB | 30 | 180GB | $3.60 | Source |
![]() |
4x L40S | 192GB | 28 | 58GB | $4.00 | Source |
![]() |
4x L40S | 192GB | 64 | 512GB | $4.32 | Source |
![]() |
4x L40S | 192GB | 32 | 384GB | $6.10 | Source |
![]() |
4x L40S | 192GB | 32 | 255GB | $7.14 | Source |
![]() |
4x L40S | 192GB | 60 | 360GB | $7.20 | Source |
![]() |
8x L40S | 384GB | 28 | 58GB | $8.00 | Source |
![]() |
8x L40S | 384GB | 64 | 768GB | $12.20 | Source |
![]() |
8x L40S | 384GB | 64 | 512GB | $14.29 | Source |
Note: Prices are subject to change and may vary by region and other factors not listed here. For some GPUs, I include links to Shadeform (the sponsor) so you can check if they're available right now. I don’t earn a commission when you click on these links, but their monthly sponsorship helps me keep the site running.
Nvidia L40S specs
GPU Architecture | NVIDIA Ada Lovelace Architecture |
GPU Memory | 48GB GDDR6 with ECC |
Memory Bandwidth | 864GB/s |
Interconnect Interface | PCIe Gen4 x16: 64GB/s bidirectional |
NVIDIA Ada Lovelace Architecture-Based CUDA® Cores | 18,176 |
NVIDIA Third-Generation RT Cores | 142 |
NVIDIA Fourth-Generation Tensor Cores | 568 |
RT Core Performance TFLOPS | 209 |
FP32 TFLOPS | 91.6 |
TF32 Tensor Core TFLOPS | 183 |
BFLOAT16 Tensor Core TFLOPS | 362.05 |
FP16 Tensor Core | 362.05 |
FP8 Tensor Core | 733 |
Peak INT8 Tensor TOPS | 733 |
Peak INT4 Tensor TOPS | 733 |
Form Factor | 4.4" (H) x 10.5" (L), dual slot |
Display Ports | 4x DisplayPort 1.4a |
Max Power Consumption | 350W |
Power Connector | 16-pin |
Thermal | Passive |
Virtual GPU (vGPU) Software Support | Yes |
vGPU Profiles Supported | See the virtual GPU licensing guide |
NVENC, NVDEC | 3x, 3x (includes AV1 encode and decode) |
Secure Boot With Root of Trust | Yes |
NEBS Ready | Level 3 |
MIG Support | No |
NVIDIA® NVLink® Support | No |
Source: official Nvidia L40S datasheet.