Nvidia A16 vs Nvidia RTX 3060

A data center GPU against a consumer card on the Ampere architecture: 16 GB GDDR6 against 12 GB GDDR6 and 80% more memory bandwidth on the RTX 3060.

At a glance

Updated 3 minutes ago

Nvidia A16

Nvidia RTX 3060

Cheapest listed price per GPU per hour by billing type, and the median across providers.

Billing	A16	RTX 3060	Difference
On-demand	$0.47	$0.04	12x more expensive on A16
Spot	No spot listings	$0.03
Reserved	No reserved listings	$0.05
Median	$0.56	$0.07	8.6x more expensive on A16

Median: Median across providers, one vote each, so a large catalog does not outweigh a small one.

Weekly median on-demand price per GPU per hour

Last 12 months

Aggregating historical prices...

Spec	A16	RTX 3060	Difference
Memory
Capacity	16 GB GDDR6	12 GB GDDR6	1.3x more on A16
Bandwidth	200 GB/s	360 GB/s	1.8x higher on RTX 3060
Bus width	128-bit	192-bit	1.5x wider on RTX 3060
Compute · dense
FP16 / BF16	17.9 TFLOPS	25.5 TFLOPS	1.4x higher on RTX 3060
INT8	35.9 TOPS	101.9 TOPS	2.8x higher on RTX 3060
FP32	4.5 TFLOPS	12.7 TFLOPS	2.8x higher on RTX 3060
Platform
Interconnect	PCIe only	PCIe only
Released	Q2 2021	Q1 2021
Precision
Supported formats	FP16BF16TF32FP32INT4INT8	FP16BF16TF32FP32INT4INT8

Figures are for each model's headline configuration. Where a form factor carries a different number, it is named under the figure.

Compute: Vendor peak figures, dense and per GPU. Not measured throughput.

Providers listing these GPUs, those with both first, so you can switch without moving clouds.