A data center GPU against a consumer card, one Ampere and one Ada Lovelace: 24 GB GDDR6 against 8 GB GDDR6 and 2.2x the memory bandwidth on the A10G.

At a glance

Memory

A10G
24 GB
RTX 4060
8 GB

3x more on A10G

Memory bandwidth

A10G
600 GB/s
RTX 4060
272 GB/s

2.2x higher on A10G

Cheapest on-demand

A10G
$1.00 /GPU/hr
RTX 4060
$0.08 /GPU/hr

12x more expensive on A10G

Price comparison

Median price per GPU per hour by billing type, with the cheapest listing under it.

Billing A10G RTX 4060 Difference
On-demand -- /GPU/hr from $1.00 -- /GPU/hr from $0.08
Reserved -- /GPU/hr from $0.43 (36 mo) -- /GPU/hr from $0.21 (24 mo)
Spot No spot listings -- /GPU/hr from $0.05

Heads up: A provider's own page may quote a different figure, for example on tax, region or a promotion. A monthly-only plan shows a derived hourly rate. Medians are across providers, one vote each, so a large catalog does not outweigh a small one. No median for on-demand and reserved on the A10G and on-demand, reserved and spot on the RTX 4060: we only show one when at least 3 providers list the GPU on that billing type. Verify before provisioning. More on how we price.

Price history

A10G vs RTX 4060 price history

Weekly median on-demand price per GPU per hour

Last 12 months
Aggregating historical prices...

Specs comparison

Spec A10G RTX 4060 Difference
Memory
Capacity 24 GB GDDR6 8 GB GDDR6 3x more on A10G
Bandwidth 600 GB/s 272 GB/s 2.2x higher on A10G
Bus width 128-bit
Compute · dense
FP8 Not supported 60.5 TFLOPS RTX 4060 only
FP16 / BF16 70 TFLOPS 30.2 TFLOPS 2.3x higher on A10G
INT8 140 TOPS 120.9 TOPS 1.2x higher on A10G
FP32 35 TFLOPS 15.1 TFLOPS 2.3x higher on A10G
Platform
Interconnect PCIe only PCIe only
Board power 300 W 115 W 2.6x higher on A10G
Released Q2 2021 Q2 2023 2 years newer on RTX 4060
Precision
Supported formats FP16BF16TF32FP32INT4INT8 FP8FP16BF16TF32FP32INT4INT8

Compute: Vendor peak figures, dense and per GPU. Not measured throughput.

Source: A10G datasheet and RTX 4060 datasheet.

Where to rent them

Providers listing these GPUs, those with both first, so you can switch without moving clouds.

Provider A10G /GPU/hr RTX 4060 /GPU/hr
Hugging Face logo Hugging Face On-Demand $1.00 --
Amazon Web Services logo AWS On-Demand $1.01 --
Salad logo Salad -- On-Demand $0.08
Theta EdgeCloud logo Theta EdgeCloud -- On-Demand $0.13
Database Mart logo Database Mart -- Reserved (24mo) $0.21

Similar GPUs

Other comparisons in the same class.

Our data for Nvidia A10G was last updated on Sept. 7, 2026, and for Nvidia RTX 4060 on Sept. 7, 2026.