Nvidia A40 vs Nvidia GB300

The GB300 is newer, with 6x the memory and 11x the bandwidth. The A40 is cheaper right now.

At a glance

Memory

6x more on GB300

A40: 48 GB

GB300: 288 GB

Memory bandwidth

11x higher on GB300

A40: 696 GB/s

GB300: 8,000 GB/s

Cheapest on-demand

97% cheaper on A40

A40: $0.49 /GPU/hr

GB300: $18.00 /GPU/hr

Price comparison

Median price per GPU per hour by billing type, with the cheapest listing under it.

Billing	A40	GB300
On-demand	$0.64 /GPU/hr from $0.49	-- /GPU/hr from $18.00
Reserved	-- /GPU/hr from $0.61 (24 mo)	On request
Spot	-- /GPU/hr from $0.31	Sold out

Heads up: A provider's own page may quote a different figure, for example on tax, region or a promotion. A monthly-only plan shows a derived hourly rate. Medians are across providers, one vote each, so a large catalog does not outweigh a small one. No median for reserved and spot on the A40 and on-demand on the GB300: we only show one when at least 3 providers list the GPU on that billing type. Verify before provisioning. More on how we price.

Price history

A40 vs GB300 price history

Weekly median on-demand price per GPU per hour

Last 12 months

Aggregating historical prices...

Specs comparison

Spec	A40	GB300	Difference
Memory
Capacity	48 GB GDDR6	288 GB HBM3e	6x more on GB300
Bandwidth	696 GB/s	8,000 GB/s	11x higher on GB300
Bus width	384-bit	8,192-bit	21x wider on GB300
Compute · dense
FP4	Not supported	15,000 TFLOPS	GB300 only
FP8	Not supported	5,000 TFLOPS	GB300 only
FP16 / BF16	149.7 TFLOPS	2,500 TFLOPS	17x higher on GB300
INT8	299.3 TOPS	165 TOPS	81% higher on A40
FP32	37.4 TFLOPS	80 TFLOPS	2.1x higher on GB300
FP64	Not supported	1.3 TFLOPS	GB300 only
Platform
Interconnect	PCIe only	NVLink 1,800 GB/s	NVLink on GB300 only
Board power	300 W	1,400 W	4.7x higher on GB300
Released	Q4 2020	Q1 2025	4 years newer on GB300
Precision
Supported formats	FP16BF16TF32FP32INT4INT8	FP4FP6FP8FP16BF16TF32FP32FP64INT8

Compute: Vendor peak figures, dense and per GPU. Not measured throughput.

Source: A40 datasheet and GB300 datasheet.

Where to rent them

Providers that rent these GPUs, with each one's cheapest rate. No provider we track offers both right now.

Provider	A40	GB300
GPU.ai UAE	$0.49 /GPU/hr On-demand	--
Runpod USA	$0.49 /GPU/hr On-demand	--
Vast.ai USA	$0.79 /GPU/hr On-demand	--
Exoscale Switzerland	$1.05 /GPU/hr On-demand	--
Database Mart USA	$0.61 /GPU/hr Reserved	--
Utho India	$0.64 /GPU/hr Reserved	--
Sesterce France	$1.21 /GPU/hr On-demand	--
EmpirioLabs AI USA	$1.49 /GPU/hr On-demand	--
Oracle Cloud USA	--	$18.00 /GPU/hr On-demand NVL
AWS USA	--	On request Reserved
CoreWeave USA	--	On request Custom NVL
Gcore Luxembourg	--	On request Custom NVL
Nebius Netherlands	--	On request Custom NVL
Together AI USA	--	On request Custom NVL
Verda Finland	--	$9.15 /GPU/hr On-demand SXM