Nvidia L40S

Compare prices for Nvidia L40S across cloud providers.

Nov. 7, 2024 (updated)

Pricing

Provider GPUs VRAM vCPUs RAM Price/h
RunPod 1x L40S 48GB 12 62GB $0.79
RunPod 1x L40S 48GB 16 250GB $0.99
Hyperstack 1x L40S 48GB 28 58GB $1.00 Launch
Massed Compute 1x L40S 48GB 22 128GB $1.10 Launch
Fly.io 1x L40S 48GB -- -- $1.25
FluidStack 1x L40S 48GB 32 48GB $1.25
DataCrunch 1x L40S 48GB 20 60GB $1.36 Launch
Crusoe 1x L40S 48GB 8 147GB $1.45 Launch
Scaleway 1x L40S 48GB 8 96GB $1.53
Nebius 1x L40S 48GB 8 32GB $1.58 Launch
Civo 1x L40S 48GB 8 64GB $1.79
OVH 1x L40S 48GB 15 90GB $1.80
Koyeb 1x L40S 48GB 30 92GB $2.00
Vultr 1x L40S 48GB 16 240GB $2.23
Scaleway 2x L40S 96GB 16 192GB $3.05
Civo 2x L40S 96GB 16 128GB $3.57
OVH 2x L40S 96GB 30 180GB $3.60
Contabo 4x L40S 192GB 64 512GB $4.33
Scaleway 4x L40S 192GB 32 384GB $6.10
Civo 4x L40S 192GB 32 255GB $7.14
OVH 4x L40S 192GB 60 360GB $7.20
Scaleway 8x L40S 384GB 64 768GB $12.20
Civo 8x L40S 384GB 64 512GB $14.29

Note: Prices are subject to change, and may vary by region and other factors not listed here. I included links to launch GPUs using Shadeform (our sponsor) so you can see if they're available right now. There's no fees to use their service and I don't get a commission when you use these links.

Specs

GPU Architecture NVIDIA Ada Lovelace Architecture
GPU Memory 48GB GDDR6 with ECC
Memory Bandwidth 864GB/s
Interconnect Interface PCIe Gen4 x16: 64GB/s bidirectional
NVIDIA Ada Lovelace Architecture-Based CUDA® Cores 18,176
NVIDIA Third-Generation RT Cores 142
NVIDIA Fourth-Generation Tensor Cores 568
RT Core Performance TFLOPS 209
FP32 TFLOPS 91.6
TF32 Tensor Core TFLOPS 183
BFLOAT16 Tensor Core TFLOPS 362.05
FP16 Tensor Core 362.05
FP8 Tensor Core 733
Peak INT8 Tensor TOPS 733
Peak INT4 Tensor TOPS 733
Form Factor 4.4" (H) x 10.5" (L), dual slot
Display Ports 4x DisplayPort 1.4a
Max Power Consumption 350W
Power Connector 16-pin
Thermal Passive
Virtual GPU (vGPU) Software Support Yes
vGPU Profiles Supported See the virtual GPU licensing guide
NVENC, NVDEC 3x, 3x (includes AV1 encode and decode)
Secure Boot With Root of Trust Yes
NEBS Ready Level 3
MIG Support No
NVIDIA® NVLink® Support No

You can find the official datasheet here.


Looking for alternatives? Compare Nvidia L40S against other GPUs.