Nvidia H800 vs Nvidia RTX 4000 SFF Ada

The H800 has 4x the memory and 7.1x the bandwidth.

At a glance

Memory

4x more on H800

H800: 80 GB

RTX 4000 SFF Ada: 20 GB

Memory bandwidth

7.1x higher on H800

H800: 2,000 GB/s

RTX 4000 SFF Ada: 280 GB/s

Cheapest on-demand

H800: --

RTX 4000 SFF Ada: $0.42 /GPU/hr

Price comparison

Median price per GPU per hour by billing type, with the cheapest listing under it.

Billing	H800	RTX 4000 SFF Ada	Difference
On-demand	No on-demand listings	-- /GPU/hr from $0.42

Heads up: A provider's own page may quote a different figure, for example on tax, region or a promotion. A monthly-only plan shows a derived hourly rate. Medians are across providers, one vote each, so a large catalog does not outweigh a small one. No median for on-demand on the RTX 4000 SFF Ada: we only show one when at least 3 providers list the GPU on that billing type. Verify before provisioning. More on how we price.

Price history

H800 vs RTX 4000 SFF Ada price history

Weekly median on-demand price per GPU per hour

Last 6 weeks

Aggregating historical prices...

Specs comparison

Spec	H800	RTX 4000 SFF Ada	Difference
Memory
Capacity	80 GB HBM2e	20 GB GDDR6	4x more on H800
Bandwidth	2,000 GB/s	280 GB/s	7.1x higher on H800
Bus width	5,120-bit	160-bit	32x wider on H800
Compute · dense
FP8	1,513 TFLOPS	153.4 TFLOPS	9.9x higher on H800
FP16 / BF16	756.5 TFLOPS	76.7 TFLOPS	9.9x higher on H800
INT8	1,513 TOPS
FP32	51 TFLOPS	19.2 TFLOPS	2.7x higher on H800
Platform
Interconnect	NVLink 400 GB/s	PCIe only	NVLink on H800 only
Board power	350 W	70 W	5x higher on H800
Released	Q1 2023	Q2 2023
Precision
Supported formats	FP8FP16BF16TF32FP32FP64INT8	FP8FP16BF16TF32FP32INT4INT8