A data center GPU against a consumer card, one Ampere and one Ada Lovelace: 40 GB HBM2 against 8 GB GDDR6, 5.7x the memory bandwidth on the A800, and NVLink 400 GB/s on the A800 where the RTX 4060 is PCIe only.
At a glance
Updated 8 minutes ago- Memory
- 40 GB
- HBM2
- Memory bandwidth
- 1.55 TB/s
- From
- $1.18 /GPU/hr
- 1 provider
- Memory
- 8 GB
- GDDR6
- Memory bandwidth
- 272 GB/s
- From
- $0.08 /GPU/hr
- 3 providers
Price comparison
Cheapest listed price per GPU per hour by billing type, and the median across providers.
| Billing | A800 | RTX 4060 | Difference |
|---|---|---|---|
| On-demand | $1.18 | $0.08 | 15x more expensive on A800 |
| Spot | No spot listings | $0.05 | |
| Reserved | No reserved listings | $0.21 | |
| Median | $1.18 | $0.10 | 12x more expensive on A800 |
Median: Median across providers, one vote each, so a large catalog does not outweigh a small one.
Price history
A800 vs RTX 4060 price history
Weekly median on-demand price per GPU per hour
Specs comparison
| Spec | A800 | RTX 4060 | Difference |
|---|---|---|---|
| Memory | |||
| Capacity | 40 GB HBM2 | 8 GB GDDR6 | 5x more on A800 |
| Bandwidth | 1,555 GB/s | 272 GB/s | 5.7x higher on A800 |
| Bus width | 5,120-bit | 128-bit | 40x wider on A800 |
| Compute · dense | |||
| FP8 | Not supported | 60.5 TFLOPS | RTX 4060 only |
| FP16 / BF16 | 312 TFLOPS | 30.2 TFLOPS | 10x higher on A800 |
| INT8 | 623.5 TOPS | 120.9 TOPS | 5.2x higher on A800 |
| FP32 | 19.5 TFLOPS | 15.1 TFLOPS | 1.3x higher on A800 |
| FP64 | 9.7 TFLOPS | Not supported | A800 only |
| Platform | |||
| Interconnect | NVLink 400 GB/s | PCIe only | NVLink on A800 only |
| Board power | 240 W | 115 W | 2.1x higher on A800 |
| Released | Q4 2022 | Q2 2023 | 8 months newer on RTX 4060 |
| Precision | |||
| Supported formats | FP16BF16TF32FP32FP64INT4INT8 | FP8FP16BF16TF32FP32INT4INT8 | |
Figures are for each model's headline configuration. Where a form factor carries a different number, it is named under the figure.
Compute: Vendor peak figures, dense and per GPU. Not measured throughput.
Source: A800 datasheet and RTX 4060 datasheet.
Where to rent them
Providers listing these GPUs, those with both first, so you can switch without moving clouds.
| Provider | A800 /GPU/hr | RTX 4060 /GPU/hr |
|---|---|---|
|
|
On-Demand $1.18 | -- |
|
|
-- | On-Demand $0.08 |
|
|
-- | On-Demand $0.12 |
|
|
-- | Reserved (24mo) $0.21 |
Similar GPUs
Other comparisons in the same class.
Our data for Nvidia A800 was last updated on Sept. 7, 2026, and for Nvidia RTX 4060 on Sept. 7, 2026.