A data center GPU against a workstation card, one Ampere and one Blackwell: 48 GB GDDR6 against 96 GB GDDR7 and 2.3x the memory bandwidth on the RTX PRO 6000.
At a glance
Updated 6 minutes ago- Memory
- 48 GB
- GDDR6
- Memory bandwidth
- 696 GB/s
- From
- $0.49 /GPU/hr
- 6 providers
- Memory
- 96 GB
- GDDR7
- Memory bandwidth
- 1.60 TB/s
- From
- $0.66 /GPU/hr
- 43 providers
Price comparison
Cheapest listed price per GPU per hour by billing type, and the median across providers.
| Billing | A40 | RTX PRO 6000 | Difference |
|---|---|---|---|
| On-demand | $0.49 | $0.66 | 26% cheaper on A40 |
| Spot | No spot listings | $0.95 | |
| Reserved | $0.61 | $0.48 | 21% cheaper on RTX PRO 6000 |
| Median | $0.77 | $2.21 | 2.9x more expensive on RTX PRO 6000 |
Median: Median across providers, one vote each, so a large catalog does not outweigh a small one.
Price history
A40 vs RTX PRO 6000 price history
Weekly median on-demand price per GPU per hour
Specs comparison
| Spec | A40 | RTX PRO 6000 | Difference |
|---|---|---|---|
| Memory | |||
| Capacity | 48 GB GDDR6 | 96 GB GDDR7 | 2x more on RTX PRO 6000 |
| Bandwidth | 696 GB/s | 1,597 GB/s | 2.3x higher on RTX PRO 6000 |
| Bus width | 384-bit | 512-bit | 1.3x wider on RTX PRO 6000 |
| Compute · dense | |||
| FP4 | Not supported | 2,000 TFLOPS | RTX PRO 6000 only |
| FP8 | Not supported | 1,000 TFLOPS | RTX PRO 6000 only |
| FP16 / BF16 | 149.7 TFLOPS | 500 TFLOPS | 3.3x higher on RTX PRO 6000 |
| INT8 | 299.3 TOPS | 1,000 TOPS | 3.3x higher on RTX PRO 6000 |
| FP32 | 37.4 TFLOPS | 120 TFLOPS | 3.2x higher on RTX PRO 6000 |
| Platform | |||
| Interconnect | PCIe only | PCIe only | |
| Board power | 300 W | 600 W | 2x higher on RTX PRO 6000 |
| Released | Q4 2020 | Q1 2025 | 4 years newer on RTX PRO 6000 |
| Precision | |||
| Supported formats | FP16BF16TF32FP32INT4INT8 | FP4FP8FP16BF16TF32FP32INT8 | |
Compute: Vendor peak figures, dense and per GPU. Not measured throughput.
Source: A40 datasheet and RTX PRO 6000 datasheet.
Where to rent them
Providers listing these GPUs, those with both first, so you can switch without moving clouds.
| Provider | A40 /GPU/hr | RTX PRO 6000 /GPU/hr |
|---|---|---|
Runpod
|
On-Demand $0.49 | On-Demand $2.09 |
Exoscale
|
On-Demand $1.05 | -- |
Database Mart
|
Reserved (24mo) $0.61 | -- |
Utho
|
Reserved (36mo) $0.65 | -- |
Sesterce
|
On-Demand $1.21 | -- |
EmpirioLabs AI
|
On-Demand $1.49 | -- |
Packet·ai
|
-- | On-Demand $0.66 |
HyperAI
|
-- | On-Demand $0.80 |
GPUhub
|
-- | On-Demand $1.10 |
EcoHash
|
-- | On-Demand $1.89 |
Verda
|
-- | On-Demand $1.89 |
Cloudzy
|
-- | On-Demand $1.93 |
GPU.ai
|
-- | On-Demand $1.99 |
6 providers list the A40 and 43 the RTX PRO 6000. Every listing is on the A40 page and the RTX PRO 6000 page.
Similar GPUs
Other comparisons in the same class.
Our data for Nvidia A40 was last updated on Sept. 7, 2026, and for Nvidia RTX PRO 6000 on Sept. 7, 2026.