Nvidia L40S

Compare prices for Nvidia L40S across cloud providers

Feb. 24, 2025 (updated)

The Nvidia L40S is designed for high-performance AI and HPC workloads, offering improved scalability and energy efficiency. Nvidia emphasizes its capabilities for enterprise-scale training and inference tasks.

Provider GPUs VRAM vCPUs RAM Price/h
RunPod logo RunPod 1x L40S 48GB 12 62GB $0.86 Source
RunPod logo RunPod 1x L40S 48GB 8 94GB $0.99 Source
Hyperstack logo Hyperstack 2x L40S 96GB 28 58GB $1.00 Source
Hyperstack logo Hyperstack 1x L40S 48GB 28 58GB $1.00 Launch
Massed Compute logo Massed Compute 1x L40S 48GB 22 128GB $1.10 Launch
DataCrunch logo DataCrunch 1x L40S 48GB 20 60GB $1.10 Source
Fly.io logo Fly.io 1x L40S 48GB -- -- $1.25 Source
FluidStack logo FluidStack 1x L40S 48GB 32 48GB $1.25 Source
Crusoe logo Crusoe 1x L40S 48GB 8 147GB $1.45 Launch
Scaleway logo Scaleway 1x L40S 48GB 8 96GB $1.52 Launch
Nebius 1x L40S 48GB 8 32GB $1.58 Source
CUDO Compute 1x L40S 48GB 12 48GB $1.75 Launch
Civo 1x L40S 48GB 8 64GB $1.79 Source
OVH 1x L40S 48GB 15 90GB $1.80 Source
Koyeb 1x L40S 48GB 30 92GB $2.00 Source
Vultr 1x L40S 48GB 16 240GB $2.23 Source
Scaleway 2x L40S 96GB 16 192GB $3.05 Source
Civo 2x L40S 96GB 16 128GB $3.57 Source
OVH 2x L40S 96GB 30 180GB $3.60 Source
Hyperstack 4x L40S 192GB 28 58GB $4.00 Source
Contabo 4x L40S 192GB 64 512GB $4.32 Source
Scaleway 4x L40S 192GB 32 384GB $6.10 Source
Civo 4x L40S 192GB 32 255GB $7.14 Source
OVH 4x L40S 192GB 60 360GB $7.20 Source
Hyperstack 8x L40S 384GB 28 58GB $8.00 Source
Scaleway 8x L40S 384GB 64 768GB $12.20 Source
Civo 8x L40S 384GB 64 512GB $14.29 Source

Note: Prices are subject to change and may vary by region and other factors not listed here. For some GPUs, I include links to Shadeform (the sponsor) so you can check if they're available right now. I don’t earn a commission when you click on these links, but their monthly sponsorship helps me keep the site running.

Nvidia L40S specs

GPU Architecture NVIDIA Ada Lovelace Architecture
GPU Memory 48GB GDDR6 with ECC
Memory Bandwidth 864GB/s
Interconnect Interface PCIe Gen4 x16: 64GB/s bidirectional
NVIDIA Ada Lovelace Architecture-Based CUDA® Cores 18,176
NVIDIA Third-Generation RT Cores 142
NVIDIA Fourth-Generation Tensor Cores 568
RT Core Performance TFLOPS 209
FP32 TFLOPS 91.6
TF32 Tensor Core TFLOPS 183
BFLOAT16 Tensor Core TFLOPS 362.05
FP16 Tensor Core 362.05
FP8 Tensor Core 733
Peak INT8 Tensor TOPS 733
Peak INT4 Tensor TOPS 733
Form Factor 4.4" (H) x 10.5" (L), dual slot
Display Ports 4x DisplayPort 1.4a
Max Power Consumption 350W
Power Connector 16-pin
Thermal Passive
Virtual GPU (vGPU) Software Support Yes
vGPU Profiles Supported See the virtual GPU licensing guide
NVENC, NVDEC 3x, 3x (includes AV1 encode and decode)
Secure Boot With Root of Trust Yes
NEBS Ready Level 3
MIG Support No
NVIDIA® NVLink® Support No

Source: official Nvidia L40S datasheet.