The L40S is newer, with 3x the memory and 4.3x the bandwidth.
At a glance
Memory
3x more on L40S
- A16
- 16 GB
- L40S
- 48 GB
Memory bandwidth
4.3x higher on L40S
- A16
- 200 GB/s
- L40S
- 864 GB/s
Cheapest on-demand
- A16
- --
- L40S
- $0.55 /GPU/hr
Price comparison
Median price per GPU per hour by billing type, with the cheapest listing under it.
| Billing | A16 | L40S | Difference |
|---|---|---|---|
| On-demand | Sold out | $1.64 /GPU/hr from $0.55 | |
| Reserved | No reserved listings | $1.16 /GPU/hr from $0.61 (12 mo) | |
| Spot | No spot listings | $0.99 /GPU/hr from $0.74 |
Heads up: A provider's own page may quote a different figure, for example on tax, region or a promotion. A monthly-only plan shows a derived hourly rate. Medians are across providers, one vote each, so a large catalog does not outweigh a small one. Verify before provisioning. More on how we price.
Price history
A16 vs L40S price history
Weekly median on-demand price per GPU per hour
Specs comparison
| Spec | A16 | L40S | Difference |
|---|---|---|---|
| Memory | |||
| Capacity | 16 GB GDDR6 | 48 GB GDDR6 | 3x more on L40S |
| Bandwidth | 200 GB/s | 864 GB/s | 4.3x higher on L40S |
| Bus width | 128-bit | 384-bit | 3x wider on L40S |
| Compute · dense | |||
| FP8 | Not supported | 733 TFLOPS | L40S only |
| FP16 / BF16 | 17.9 TFLOPS | 362.1 TFLOPS | 20x higher on L40S |
| INT8 | 35.9 TOPS | 733 TOPS | 20x higher on L40S |
| FP32 | 4.5 TFLOPS | 91.6 TFLOPS | 20x higher on L40S |
| Platform | |||
| Interconnect | PCIe only | PCIe only | |
| Released | Q2 2021 | Q3 2023 | 2 years newer on L40S |
| Precision | |||
| Supported formats | FP16BF16TF32FP32INT4INT8 | FP8FP16BF16TF32FP32INT4INT8 | |
Compute: Vendor peak figures, dense and per GPU. Not measured throughput.
Source: A16 datasheet and L40S datasheet.
Where to rent them
Providers that rent these GPUs, with each one's cheapest rate. Providers that rent both are listed first.
| Provider | A16 | L40S |
|---|---|---|
Sesterce
France
|
$0.56 /GPU/hr On-demand | $0.97 /GPU/hr On-demand |
Novita
USA
|
-- | $0.55 /GPU/hr On-demand |
GPU.ai
UAE
|
-- | $0.80 /GPU/hr On-demand |
Packet·ai
USA
|
-- | $0.92 /GPU/hr On-demand |
Massed Compute
USA
|
-- | $0.97 /GPU/hr On-demand |
Runpod
USA
|
-- | $1.09 /GPU/hr On-demand |
Runcrate
USA
|
-- | $1.14 /GPU/hr On-demand PCIe |
UpCloud
Finland
|
-- | $1.19 /GPU/hr On-demand |
1 provider list the A16 and 37 the L40S. Every listing is on the A16 page and the L40S page.
Similar GPUs
Other comparisons in the same class.
Our data for Nvidia A16 was last updated on Sept. 14, 2026, and for Nvidia L40S on Sept. 14, 2026.