Home
Compare GPUs
A16 vs A40

Nvidia A16 vs Nvidia A40

Two Nvidia data center GPUs on the Ampere architecture: 16 GB GDDR6 against 48 GB GDDR6 and 3.5x the memory bandwidth on the A40.

At a glance

Updated 4 minutes ago

Nvidia A16

Memory: 16 GB; GDDR6
Memory bandwidth: 200 GB/s
From: $0.47 /GPU/hr; 3 providers

Nvidia A40

Memory: 48 GB; GDDR6
Memory bandwidth: 696 GB/s
From: $0.49 /GPU/hr; 7 providers

Price comparison

Cheapest listed price per GPU per hour by billing type, and the median across providers.

Billing	A16	A40	Difference
On-demand	$0.47	$0.49	Within 5%
Reserved	No reserved listings	$0.61
Median	$0.56	$0.49	13% cheaper on A40

Median: Median across providers, one vote each, so a large catalog does not outweigh a small one.

Price history

A16 vs A40 price history

Weekly median on-demand price per GPU per hour

Last 12 months

Aggregating historical prices...

Specs comparison

Spec	A16	A40	Difference
Memory
Capacity	16 GB GDDR6	48 GB GDDR6	3x more on A40
Bandwidth	200 GB/s	696 GB/s	3.5x higher on A40
Bus width	128-bit	384-bit	3x wider on A40
Compute · dense
FP16 / BF16	17.9 TFLOPS	149.7 TFLOPS	8.4x higher on A40
INT8	35.9 TOPS	299.3 TOPS	8.3x higher on A40
FP32	4.5 TFLOPS	37.4 TFLOPS	8.3x higher on A40
Platform
Interconnect	PCIe only	PCIe only
Released	Q2 2021	Q4 2020	6 months newer on A16
Precision
Supported formats	FP16BF16TF32FP32INT4INT8	FP16BF16TF32FP32INT4INT8

Compute: Vendor peak figures, dense and per GPU. Not measured throughput.

Source: A16 datasheet and A40 datasheet.

Where to rent them

Providers listing these GPUs, those with both first, so you can switch without moving clouds.

Provider	A16 /GPU/hr	A40 /GPU/hr
Sesterce	On-Demand $0.56	On-Demand $1.21
Vultr	On-Demand $0.47	--
Runcrate	On-Demand $0.56	--
GPU.ai	--	On-Demand $0.49
Runpod	--	On-Demand $0.49
Exoscale	--	On-Demand $1.05
Database Mart	--	Reserved (24mo) $0.61
Utho	--	Reserved (36mo) $0.65
EmpirioLabs AI	--	On-Demand $1.49

Built for agents: CLI, SDK and MCP server. Your agent rents and runs GPUs itself.

A permissionless marketplace. 1000+ nodes from independent providers worldwide.

Hard to find nodes available; B200 and B300 Blackwell nodes listed now.

Consumer + DC grade cards for cheap. H100s from $1/hr, RTX 5090s from $0.35/hr.

Similar GPUs

Other comparisons in the same class.

Nvidia L4

24 GB GDDR6 · 50% more bandwidth than the A16

From $0.31 /GPU/hr Compare
Nvidia T4

16 GB GDDR6 · 50% more bandwidth than the A16

From $0.15 /GPU/hr Compare
Nvidia A10

24 GB GDDR6 · 3x the bandwidth of the A16

From $0.20 /GPU/hr Compare
Nvidia RTX 6000 Ada

48 GB GDDR6 · 38% more bandwidth than the A40

From $0.55 /GPU/hr Compare
Nvidia A5000

24 GB GDDR6 · NVLink 112 GB/s

From $0.23 /GPU/hr Compare

Browse all GPUs

Our data for Nvidia A16 was last updated on Sept. 7, 2026, and for Nvidia A40 on Sept. 7, 2026.