A workstation GPU against a data center card, one Ampere and one Hopper: 16 GB GDDR6 against 141 GB HBM3e, 11x the memory bandwidth on the H200, and NVLink 900 GB/s on the H200 where the A4000 is PCIe only.

At a glance

Updated 6 minutes ago
Memory
16 GB
GDDR6
Memory bandwidth
448 GB/s
From
$0.15 /GPU/hr
11 providers
Memory
141 GB
HBM3e
Memory bandwidth
4.80 TB/s
From
$2.09 /GPU/hr
46 providers

Price comparison

Cheapest listed price per GPU per hour by billing type, and the median across providers.

Billing A4000 H200 Difference
On-demand $0.15 $2.09 14x more expensive on H200
Spot No spot listings $2.45
Reserved $0.11 $2.29 21x more expensive on H200
Median $0.21 $4.40 21x more expensive on H200

Median: Median across providers, one vote each, so a large catalog does not outweigh a small one.

Price history

A4000 vs H200 price history

Weekly median on-demand price per GPU per hour

Last 12 months
Aggregating historical prices...

Specs comparison

Spec A4000 H200 Difference
Memory
Capacity 16 GB GDDR6 141 GB HBM3e 8.8x more on H200
Bandwidth 448 GB/s 4,800 GB/s 11x higher on H200
Bus width 256-bit
Compute · dense
FP8 Not supported 1,979 TFLOPS H200 only
FP16 / BF16 76.7 TFLOPS 989.5 TFLOPS 13x higher on H200
INT8 1,979 TOPS
FP32 19.2 TFLOPS 67 TFLOPS 3.5x higher on H200
FP64 Not supported 34 TFLOPS H200 only
Platform
Interconnect PCIe only NVLink 900 GB/s NVLink on H200 only
Board power 140 W 700 W 5x higher on H200
Released Q2 2021 Q4 2023 3 years newer on H200
Precision
Supported formats FP16BF16TF32FP32INT4INT8 FP8FP16BF16TF32FP32FP64INT8

Compute: Vendor peak figures, dense and per GPU. Not measured throughput.

Source: A4000 datasheet and H200 datasheet.

Where to rent them

Providers listing these GPUs, those with both first, so you can switch without moving clouds.

Provider A4000 /GPU/hr H200 /GPU/hr
Runcrate logo Runcrate On-Demand $0.17 On-Demand $4.40
Sesterce logo Sesterce On-Demand $0.88 --
Hyperstack logo Hyperstack On-Demand $0.15 --
TensorDock logo TensorDock On-Demand $0.21 --
Paperspace logo Paperspace On-Demand $0.76 --
Database Mart logo Database Mart Reserved (24mo) $0.17 --
Cirrascale logo Cirrascale Reserved (12mo) $0.28 --
Runpod logo Runpod Reservation on request --
Koyeb logo Koyeb -- On-Demand $3.00
Lium logo Lium -- On-Demand $3.00
Vast.ai logo Vast.ai -- On-Demand $3.09
GPU.ai logo GPU.ai -- On-Demand $3.29
Massed Compute logo Massed Compute -- On-Demand $3.62
Verda logo Verda -- On-Demand $4.00
Lyceum logo Lyceum -- On-Demand $4.29

11 providers list the A4000 and 46 the H200. Every listing is on the A4000 page and the H200 page.

Similar GPUs

Other comparisons in the same class.

Our data for Nvidia A4000 was last updated on Sept. 7, 2026, and for Nvidia H200 on Sept. 7, 2026.