A data center GPU against a consumer card, one Ampere and one Ada Lovelace: 40 GB HBM2 against 8 GB GDDR6, 5.7x the memory bandwidth on the A800, and NVLink 400 GB/s on the A800 where the RTX 4060 is PCIe only.

At a glance

Updated 8 minutes ago
Memory
40 GB
HBM2
Memory bandwidth
1.55 TB/s
From
$1.18 /GPU/hr
1 provider
Memory
8 GB
GDDR6
Memory bandwidth
272 GB/s
From
$0.08 /GPU/hr
3 providers

Price comparison

Cheapest listed price per GPU per hour by billing type, and the median across providers.

Billing A800 RTX 4060 Difference
On-demand $1.18 $0.08 15x more expensive on A800
Spot No spot listings $0.05
Reserved No reserved listings $0.21
Median $1.18 $0.10 12x more expensive on A800

Median: Median across providers, one vote each, so a large catalog does not outweigh a small one.

Price history

A800 vs RTX 4060 price history

Weekly median on-demand price per GPU per hour

Last 12 months
Aggregating historical prices...

Specs comparison

Spec A800 RTX 4060 Difference
Memory
Capacity 40 GB HBM2 8 GB GDDR6 5x more on A800
Bandwidth 1,555 GB/s 272 GB/s 5.7x higher on A800
Bus width 5,120-bit 128-bit 40x wider on A800
Compute · dense
FP8 Not supported 60.5 TFLOPS RTX 4060 only
FP16 / BF16 312 TFLOPS 30.2 TFLOPS 10x higher on A800
INT8 623.5 TOPS 120.9 TOPS 5.2x higher on A800
FP32 19.5 TFLOPS 15.1 TFLOPS 1.3x higher on A800
FP64 9.7 TFLOPS Not supported A800 only
Platform
Interconnect NVLink 400 GB/s PCIe only NVLink on A800 only
Board power 240 W 115 W 2.1x higher on A800
Released Q4 2022 Q2 2023 8 months newer on RTX 4060
Precision
Supported formats FP16BF16TF32FP32FP64INT4INT8 FP8FP16BF16TF32FP32INT4INT8

Figures are for each model's headline configuration. Where a form factor carries a different number, it is named under the figure.

Compute: Vendor peak figures, dense and per GPU. Not measured throughput.

Source: A800 datasheet and RTX 4060 datasheet.

Where to rent them

Providers listing these GPUs, those with both first, so you can switch without moving clouds.

Provider A800 /GPU/hr RTX 4060 /GPU/hr
GPUhub logo GPUhub On-Demand $1.18 --
Salad logo Salad -- On-Demand $0.08
Theta EdgeCloud logo Theta EdgeCloud -- On-Demand $0.12
Database Mart logo Database Mart -- Reserved (24mo) $0.21

Similar GPUs

Other comparisons in the same class.

Our data for Nvidia A800 was last updated on Sept. 7, 2026, and for Nvidia RTX 4060 on Sept. 7, 2026.