AMD MI250 vs Nvidia GB200

Two data center GPUs, one CDNA2 and one Grace Blackwell: 128 GB HBM2e against 186 GB HBM3e and 2.5x the memory bandwidth on the GB200.

At a glance

Updated 9 hours ago

AMD MI250

Nvidia GB200

Cheapest listed price per GPU per hour by billing type, and the median across providers.

Billing	MI250	GB200	Difference
On-demand	Not sold on demand	$10.50
Spot	No spot listings	$27.04
Reserved	$1.30	$10.58	8.1x more expensive on GB200
Median	$1.50	$16.00	11x more expensive on GB200

Median: Median across providers, one vote each, so a large catalog does not outweigh a small one.

Weekly median on-demand price per GPU per hour

Last 12 months

Aggregating historical prices...

Spec	MI250	GB200	Difference
Memory
Capacity	128 GB HBM2e	186 GB HBM3e	1.5x more on GB200
Bandwidth	3,200 GB/s	8,000 GB/s	2.5x higher on GB200
Bus width	8,192-bit
Compute · dense
FP4	Not supported	10,000 TFLOPS	GB200 only
FP8	Not supported	5,000 TFLOPS	GB200 only
FP16 / BF16	362.1 TFLOPS	2,500 TFLOPS	6.9x higher on GB200
INT8	362.1 TOPS	5,000 TOPS	14x higher on GB200
FP32	90.5 TFLOPS	80 TFLOPS	1.1x higher on MI250
FP64	45.3 TFLOPS	40 TFLOPS	1.1x higher on MI250
Platform
Interconnect	Infinity Fabric 400 GB/s	NVLink 1,800 GB/s	4.5x higher on GB200
Board power	500 W	1,200 W	2.4x higher on GB200
Released	Q4 2021	Q1 2024	2 years newer on GB200
Precision
Supported formats	FP16BF16FP32FP64INT4INT8	FP4FP6FP8FP16BF16TF32FP32FP64INT8

Compute: Vendor peak figures, dense and per GPU. Not measured throughput.

Providers listing these GPUs, those with both first, so you can switch without moving clouds.