A workstation GPU against a data center card, one Ampere and one Ada Lovelace: 12 GB GDDR6 against 48 GB GDDR6 and 3x the memory bandwidth on the L40.
At a glance
Memory
- RTX A2000
- 12 GB
- L40
- 48 GB
4x more on L40
Memory bandwidth
- RTX A2000
- 288 GB/s
- L40
- 864 GB/s
3x higher on L40
Cheapest on-demand
- RTX A2000
- --
- L40
- $0.78 /GPU/hr
Price comparison
Median price per GPU per hour by billing type, with the cheapest listing under it.
| Billing | RTX A2000 | L40 | Difference |
|---|---|---|---|
| On-demand | Sold out | $1.05 /GPU/hr from $0.78 | |
| Reserved | No reserved listings | -- /GPU/hr from $0.70 | |
| Spot | No spot listings | $0.79 /GPU/hr from $0.77 |
Heads up: A provider's own page may quote a different figure, for example on tax, region or a promotion. A monthly-only plan shows a derived hourly rate. Medians are across providers, one vote each, so a large catalog does not outweigh a small one. No median for reserved on the L40: we only show one when at least 3 providers list the GPU on that billing type. Verify before provisioning. More on how we price.
Price history
RTX A2000 vs L40 price history
Weekly median on-demand price per GPU per hour
Specs comparison
| Spec | RTX A2000 | L40 | Difference |
|---|---|---|---|
| Memory | |||
| Capacity | 12 GB GDDR6 | 48 GB GDDR6 | 4x more on L40 |
| Bandwidth | 288 GB/s | 864 GB/s | 3x higher on L40 |
| Bus width | 192-bit | 384-bit | 2x wider on L40 |
| Compute · dense | |||
| FP8 | Not supported | 362 TFLOPS | L40 only |
| FP16 / BF16 | 31.9 TFLOPS | 181.1 TFLOPS | 5.7x higher on L40 |
| INT8 | 362 TOPS | ||
| FP32 | 8 TFLOPS | 90.5 TFLOPS | 11x higher on L40 |
| Platform | |||
| Interconnect | PCIe only | PCIe only | |
| Board power | 70 W | 300 W | 4.3x higher on L40 |
| Released | Q3 2021 | Q4 2022 | 14 months newer on L40 |
| Precision | |||
| Supported formats | FP16BF16TF32FP32INT4INT8 | FP8FP16BF16TF32FP32INT4INT8 | |
Figures are for each model's headline configuration. Where a form factor carries a different number, it is named under the figure.
Compute: Vendor peak figures, dense and per GPU. Not measured throughput.
Source: RTX A2000 datasheet and L40 datasheet.
Where to rent them
Providers listing these GPUs, those with both first, so you can switch without moving clouds.
| Provider | RTX A2000 /GPU/hr | L40 /GPU/hr |
|---|---|---|
Runpod
|
On-Demand $0.12 | -- |
GPU.ai
|
-- | On-Demand $0.78 |
Thunder Compute
|
-- | On-Demand $0.79 |
Massed Compute
|
-- | On-Demand $0.86 |
Sesterce
|
-- | On-Demand $0.97 |
Runcrate
|
-- | On-Demand $0.97 |
Oblivus
|
-- | On-Demand $1.05 |
Spheron
|
-- | On-Demand $1.06 |
EmpirioLabs AI
|
-- | On-Demand $1.50 |
1 provider list the RTX A2000 and 12 the L40. Every listing is on the RTX A2000 page and the L40 page.
Similar GPUs
Other comparisons in the same class.
Our data for Nvidia RTX A2000 was last updated on Sept. 7, 2026, and for Nvidia L40 on Sept. 7, 2026.