Nvidia L40S
Compare prices for Nvidia L40S across cloud providers.
Nov. 7, 2024 (updated)
Pricing
Provider | GPUs | VRAM | vCPUs | RAM | Price/h | |
---|---|---|---|---|---|---|
RunPod | 1x L40S | 48GB | 12 | 62GB | $0.79 | |
RunPod | 1x L40S | 48GB | 16 | 250GB | $0.99 | |
Hyperstack | 1x L40S | 48GB | 28 | 58GB | $1.00 | Launch |
Massed Compute | 1x L40S | 48GB | 22 | 128GB | $1.10 | Launch |
Fly.io | 1x L40S | 48GB | -- | -- | $1.25 | |
FluidStack | 1x L40S | 48GB | 32 | 48GB | $1.25 | |
DataCrunch | 1x L40S | 48GB | 20 | 60GB | $1.36 | Launch |
Crusoe | 1x L40S | 48GB | 8 | 147GB | $1.45 | Launch |
Scaleway | 1x L40S | 48GB | 8 | 96GB | $1.53 | |
Nebius | 1x L40S | 48GB | 8 | 32GB | $1.58 | Launch |
Civo | 1x L40S | 48GB | 8 | 64GB | $1.79 | |
OVH | 1x L40S | 48GB | 15 | 90GB | $1.80 | |
Koyeb | 1x L40S | 48GB | 30 | 92GB | $2.00 | |
Vultr | 1x L40S | 48GB | 16 | 240GB | $2.23 | |
Scaleway | 2x L40S | 96GB | 16 | 192GB | $3.05 | |
Civo | 2x L40S | 96GB | 16 | 128GB | $3.57 | |
OVH | 2x L40S | 96GB | 30 | 180GB | $3.60 | |
Contabo | 4x L40S | 192GB | 64 | 512GB | $4.33 | |
Scaleway | 4x L40S | 192GB | 32 | 384GB | $6.10 | |
Civo | 4x L40S | 192GB | 32 | 255GB | $7.14 | |
OVH | 4x L40S | 192GB | 60 | 360GB | $7.20 | |
Scaleway | 8x L40S | 384GB | 64 | 768GB | $12.20 | |
Civo | 8x L40S | 384GB | 64 | 512GB | $14.29 | |
Note: Prices are subject to change, and may vary by region and other factors not listed here. I included links to launch GPUs using Shadeform (our sponsor) so you can see if they're available right now. There's no fees to use their service and I don't get a commission when you use these links.
Specs
GPU Architecture | NVIDIA Ada Lovelace Architecture |
GPU Memory | 48GB GDDR6 with ECC |
Memory Bandwidth | 864GB/s |
Interconnect Interface | PCIe Gen4 x16: 64GB/s bidirectional |
NVIDIA Ada Lovelace Architecture-Based CUDA® Cores | 18,176 |
NVIDIA Third-Generation RT Cores | 142 |
NVIDIA Fourth-Generation Tensor Cores | 568 |
RT Core Performance TFLOPS | 209 |
FP32 TFLOPS | 91.6 |
TF32 Tensor Core TFLOPS | 183 |
BFLOAT16 Tensor Core TFLOPS | 362.05 |
FP16 Tensor Core | 362.05 |
FP8 Tensor Core | 733 |
Peak INT8 Tensor TOPS | 733 |
Peak INT4 Tensor TOPS | 733 |
Form Factor | 4.4" (H) x 10.5" (L), dual slot |
Display Ports | 4x DisplayPort 1.4a |
Max Power Consumption | 350W |
Power Connector | 16-pin |
Thermal | Passive |
Virtual GPU (vGPU) Software Support | Yes |
vGPU Profiles Supported | See the virtual GPU licensing guide |
NVENC, NVDEC | 3x, 3x (includes AV1 encode and decode) |
Secure Boot With Root of Trust | Yes |
NEBS Ready | Level 3 |
MIG Support | No |
NVIDIA® NVLink® Support | No |
You can find the official datasheet here.
Looking for alternatives? Compare Nvidia L40S against other GPUs.