Home
Compare GPUs
H20 vs P40

Nvidia H20 vs Nvidia P40

Two Nvidia data center GPUs, one Hopper and one Pascal: 96 GB HBM3 against 24 GB GDDR5 and 12x the memory bandwidth on the H20.

At a glance

Memory

H20: 96 GB
P40: 24 GB

4x more on H20

Memory bandwidth

H20: 4,000 GB/s
P40: 346 GB/s

12x higher on H20

Cheapest on-demand

H20: --
P40: --

Price comparison

Median price per GPU per hour by billing type, with the cheapest listing under it.

Price history

H20 vs P40 price history

Weekly median on-demand price per GPU per hour

Last 13 months

Aggregating historical prices...

Specs comparison

Spec	H20	P40	Difference
Memory
Capacity	96 GB HBM3	24 GB GDDR5	4x more on H20
Bandwidth	4,000 GB/s	346 GB/s	12x higher on H20
Bus width		384-bit
Platform
Interconnect	PCIe only	PCIe only
Board power	400 W	250 W	1.6x higher on H20
Released	Q1 2024	Q3 2016	7 years newer on H20
Precision
Supported formats	FP8FP16BF16TF32FP32FP64INT8	FP16FP32INT8

Source: P40 datasheet.

Built for agents: CLI, SDK and MCP server. Your agent rents and runs GPUs itself.

A permissionless marketplace. 1000+ nodes from independent providers worldwide.

Hard to find nodes available; B200 and B300 Blackwell nodes listed now.

Consumer + DC grade cards for cheap. H100s from $1/hr, RTX 5090s from $0.35/hr.

Similar GPUs

Other comparisons in the same class.

Nvidia H100

80 GB HBM3 · 16% less bandwidth than the H20

From $1.50 /GPU/hr Compare
Nvidia A100

80 GB HBM2e · 52% less bandwidth than the H20

From $0.89 /GPU/hr Compare
Nvidia L40S

48 GB GDDR6 · 78% less bandwidth than the H20

From $0.55 /GPU/hr Compare
Nvidia L4

24 GB GDDR6 · 13% less bandwidth than the P40

From $0.44 /GPU/hr Compare
Nvidia T4

16 GB GDDR6 · 13% less bandwidth than the P40

From $0.20 /GPU/hr Compare

Browse all GPUs Compare other GPUs

Our data for Nvidia H20 was last updated on Sept. 7, 2026, and for Nvidia P40 on Sept. 7, 2026.