Nvidia L40S

Compare prices for Nvidia L40S across cloud providers

May 19, 2025 (updated)

The Nvidia L40S is designed for high-performance AI and HPC workloads, offering improved scalability and energy efficiency. Nvidia emphasizes its capabilities for enterprise-scale training and inference tasks.

Provider GPUs VRAM vCPUs RAM Price/h
RunPod logo RunPod 1x L40S 48GB 12 62GB $0.86 Source
RunPod logo RunPod 1x L40S 48GB 8 94GB $0.99 Source
Massed Compute logo Massed Compute 1x L40S 48GB 22 128GB $1.10 Launch
DataCrunch logo DataCrunch 1x L40S 48GB 20 60GB $1.10 Source
Contabo logo Contabo 1x L40S 48GB 32 106GB $1.17 Source
Sesterce logo Sesterce 1x L40S 48GB 22 -- $1.21 Source
Fly.io logo Fly.io 1x L40S 48GB -- -- $1.25 Source
FluidStack logo FluidStack 1x L40S 48GB 24 64GB $1.30 Source
Crusoe logo Crusoe 1x L40S 48GB 8 147GB $1.45 Launch
Nebius logo Nebius 1x L40S 48GB 8 32GB $1.58 Source
Scaleway 1x L40S 48GB 8 48GB $1.61 Launch
CUDO Compute 1x L40S 48GB 12 48GB $1.75 Launch
Civo 1x L40S 48GB 8 64GB $1.79 Source
OVH 1x L40S 48GB 15 90GB $1.80 Source
AWS 1x L40S 48GB 4 32GB $1.87 Source
Koyeb 1x L40S 48GB 30 92GB $2.00 Source
Vultr 1x L40S 48GB 16 240GB $2.23 Source
AWS 1x L40S 48GB 8 64GB $2.24 Source
Sesterce 2x L40S 96GB 44 -- $2.86 Source
AWS 1x L40S 48GB 16 128GB $3.00 Source
Scaleway 2x L40S 96GB 16 192GB $3.15 Launch
Civo 2x L40S 96GB 16 128GB $3.57 Source
OVH 2x L40S 96GB 30 180GB $3.60 Source
Contabo 4x L40S 192GB 64 512GB $4.47 Source
AWS 1x L40S 48GB 32 256GB $4.53 Source
Sesterce 4x L40S 192GB 88 -- $5.72 Source
Scaleway 4x L40S 192GB 32 384GB $6.23 Source
Sesterce 8x L40S 384GB 128 -- $7.04 Source
Civo 4x L40S 192GB 32 255GB $7.14 Source
OVH 4x L40S 192GB 60 360GB $7.20 Source
AWS 1x L40S 48GB 64 512GB $7.58 Source
AWS 4x L40S 192GB 48 384GB $10.49 Source
Scaleway 8x L40S 384GB 64 768GB $12.39 Launch
Civo 8x L40S 384GB 64 512GB $14.29 Source
AWS 4x L40S 192GB 96 768GB $15.07 Source
Sesterce 10x L40S 480GB 80 -- $15.95 Source
AWS 8x L40S 384GB 192 1536GB $30.13 Source

Note: Prices are subject to change and may vary by region and other factors not listed here. For some GPUs, I include links to Shadeform (the sponsor) so you can check if they're available right now. I don’t earn a commission when you click on these links, but their monthly sponsorship helps me keep the site running.

Nvidia L40S specs

GPU Architecture NVIDIA Ada Lovelace Architecture
GPU Memory 48GB GDDR6 with ECC
Memory Bandwidth 864GB/s
Interconnect Interface PCIe Gen4 x16: 64GB/s bidirectional
NVIDIA Ada Lovelace Architecture-Based CUDA® Cores 18,176
NVIDIA Third-Generation RT Cores 142
NVIDIA Fourth-Generation Tensor Cores 568
RT Core Performance TFLOPS 209
FP32 TFLOPS 91.6
TF32 Tensor Core TFLOPS 183
BFLOAT16 Tensor Core TFLOPS 362.05
FP16 Tensor Core 362.05
FP8 Tensor Core 733
Peak INT8 Tensor TOPS 733
Peak INT4 Tensor TOPS 733
Form Factor 4.4" (H) x 10.5" (L), dual slot
Display Ports 4x DisplayPort 1.4a
Max Power Consumption 350W
Power Connector 16-pin
Thermal Passive
Virtual GPU (vGPU) Software Support Yes
vGPU Profiles Supported See the virtual GPU licensing guide
NVENC, NVDEC 3x, 3x (includes AV1 encode and decode)
Secure Boot With Root of Trust Yes
NEBS Ready Level 3
MIG Support No
NVIDIA® NVLink® Support No

Source: official Nvidia L40S datasheet.