A workstation GPU against a consumer card on the Ampere architecture: 24 GB GDDR6 against 8 GB GDDR6, 71% more memory bandwidth on the A5000, and NVLink 112 GB/s on the A5000 where the RTX 3060 Ti is PCIe only.
At a glance
Updated 8 minutes ago- Memory
- 24 GB
- GDDR6
- Memory bandwidth
- 768 GB/s
- From
- $0.25 /GPU/hr
- 11 providers
- Memory
- 8 GB
- GDDR6
- Memory bandwidth
- 448 GB/s
- From
- $0.07 /GPU/hr
- 4 providers
Price comparison
Cheapest listed price per GPU per hour by billing type, and the median across providers.
| Billing | A5000 | RTX 3060 Ti | Difference |
|---|---|---|---|
| On-demand | $0.25 | $0.07 | 3.6x more expensive on A5000 |
| Spot | $0.09 | $0.03 | 3x more expensive on A5000 |
| Reserved | $0.25 | $0.25 | Within 5% |
| Median | $1.38 | $0.08 | 17x more expensive on A5000 |
Median: Median across providers, one vote each, so a large catalog does not outweigh a small one.
Price history
A5000 vs RTX 3060 Ti price history
Weekly median on-demand price per GPU per hour
Specs comparison
| Spec | A5000 | RTX 3060 Ti | Difference |
|---|---|---|---|
| Memory | |||
| Capacity | 24 GB GDDR6 | 8 GB GDDR6 | 3x more on A5000 |
| Bandwidth | 768 GB/s | 448 GB/s | 1.7x higher on A5000 |
| Bus width | 384-bit | 256-bit | 1.5x wider on A5000 |
| Compute · dense | |||
| FP16 / BF16 | 111.1 TFLOPS | 32.4 TFLOPS | 3.4x higher on A5000 |
| INT8 | 129.6 TOPS | ||
| FP32 | 27.8 TFLOPS | 16.2 TFLOPS | 1.7x higher on A5000 |
| Platform | |||
| Interconnect | NVLink 112 GB/s | PCIe only | NVLink on A5000 only |
| Board power | 230 W | 200 W | 1.1x higher on A5000 |
| Released | Q2 2021 | Q4 2020 | |
| Precision | |||
| Supported formats | FP16BF16TF32FP32INT4INT8 | FP16BF16TF32FP32INT4INT8 | |
Compute: Vendor peak figures, dense and per GPU. Not measured throughput.
Source: A5000 datasheet and RTX 3060 Ti datasheet.
Where to rent them
Providers listing these GPUs, those with both first, so you can switch without moving clouds.
| Provider | A5000 /GPU/hr | RTX 3060 Ti /GPU/hr |
|---|---|---|
|
|
On-Demand $0.25 | On-Demand $0.08 |
|
|
Reserved (24mo) $0.25 | Reserved (24mo) $0.25 |
|
|
On-Demand $1.56 | -- |
|
|
On-Demand $1.56 | -- |
|
|
On-Demand $1.14 | -- |
|
|
On-Demand $1.38 | -- |
|
|
Reserved (36mo) $0.29 | -- |
|
|
Reserved (12mo) $0.42 | -- |
|
|
-- | On-Demand $0.07 |
|
|
-- | On-Demand $0.10 |
11 providers list the A5000 and 4 the RTX 3060 Ti. Every listing is on the A5000 page and the RTX 3060 Ti page.
Similar GPUs
Other comparisons in the same class.
Our data for Nvidia A5000 was last updated on Sept. 7, 2026, and for Nvidia RTX 3060 Ti on Sept. 7, 2026.