Overview
Nvidia A100
The Nvidia A100 is a data center GPU on the Ampere architecture, released Q2 2020, with 80 GB HBM2e and 1,935 GB/s memory bandwidth on the PCIe variant.
Nvidia H200
The Nvidia H200 is a data center GPU on the Hopper architecture, released Q4 2023, with 141 GB HBM3e and 4,800 GB/s memory bandwidth.
Memory per GPU
1.8x more on H200
A100
H200
Memory bandwidth
2.5x higher on H200
A100
H200
GPU interconnect
1.5x higher on H200
A100
H200
Peak performance (FP16)
3.2x higher on H200
A100
H200
Vendor peak figures, dense and per GPU. Not measured throughput.
FP16 per watt
1.4x higher on H200
A100
H200
Board power
2.3x higher on H200
A100
H200
Precision support
A100
H200
Highlighted formats are supported by only one of the two.
Architecture
A100
H200
Released
4 years newer on H200
A100
H200
Figures are for each model's headline configuration. Where a form factor carries a different number, it is named under the figure.
Source: A100 datasheet and H200 datasheet.
Price comparison
Cheapest on-demand
3.7x higher on H200
A100
H200
Typical rate
2.5x higher on H200
A100
H200
Median across providers, one vote each, so a large catalog does not outweigh a small one.
Spot floor
8.2x higher on H200
A100
H200
Providers listing it
2 more on A100
A100
H200
Price, last 90 days
A100
H200
Change in the market-wide median, which moves when providers reprice and when cheaper or more expensive listings enter the market.
Heads up: A provider's own page may quote a different figure, for example on tax, region or a promotion. A monthly-only plan shows a derived hourly rate. Verify before provisioning. More on how we price.
Offers and availability
How this list works
Order
Each provider appears once per GPU. We pick the one configuration that speaks for that provider, and rank on it in this order:
- Availability: in stock, then waitlist, then not reported, then out of stock. A price you can act on outranks a cheaper one you cannot.
- Billing type: on-demand first, then reserved, then spot, then quote-only. On-demand leads because it is the only rate you can hold without committing to anything.
- Price: the lowest per-GPU hourly rate the provider lists, converted to USD.
The configuration we pick is chosen the same way, availability before billing before price. The rest of that provider's configurations are on the GPU's own page.
Ties sort alphabetically. Reserved rates are not separated by term length, so a three-year commitment can sit above a one-month one: the label beneath each price says which you are looking at. Providers who publish no rate are listed last within their group.
Transparency and funding
- Ads and sponsors: Paid placements sit at the top of the list and are always labeled as sponsored content. Sponsorship never influences the organic ranking itself.
- Affiliates: Affiliate links are marked. We may earn a commission if you click them, but commissions never affect the order.
- Prices: Shown in USD, converted at daily reference rates where a provider publishes in another currency. A month means 720 hours. How we estimate costs.
A100 Offers
18 of 43 providers report available stock.
H200 Offers
12 of 41 providers report available stock.
Similar GPUs
Other comparisons in the same class:
Our data for Nvidia A100 was last updated on Sept. 3, 2026, and for Nvidia H200 on Sept. 3, 2026.