Overview

Nvidia logo Nvidia A100

The Nvidia A100 is a data center GPU on the Ampere architecture, released Q2 2020, with 80 GB HBM2e and 1,935 GB/s memory bandwidth on the PCIe variant.

High Performance Datacenter

Nvidia logo Nvidia A5000

The Nvidia A5000 is a workstation GPU on the Ampere architecture, released Q2 2021, with 24 GB GDDR6 and 768 GB/s memory bandwidth.

Mid-Range Workstation

Memory per GPU

3.3x more on A100
Nvidia logo A100
80 GB HBM2e 40 GB on SXM, PCIe
Nvidia logo A5000
24 GB GDDR6

Memory bandwidth

2.5x higher on A100
Nvidia logo A100
1,935 GB/s 2,039 GB/s on SXM 1,555 GB/s on SXM, PCIe
Nvidia logo A5000
768 GB/s

GPU interconnect

5.4x higher on A100
Nvidia logo A100
NVLink 600 GB/s
Nvidia logo A5000
NVLink 112 GB/s

Peak performance (FP16)

1.4x higher on A100
Nvidia logo A100
312 TFLOPS
Nvidia logo A5000
222 TFLOPS

Vendor peak figures. Sparsity and tensor-core conventions differ between vendors.

Precision support

Nvidia logo A100
FP16 BF16 TF32 FP32 FP64 INT4 INT8
Nvidia logo A5000
FP16 BF16 TF32 FP32 INT4 INT8

Highlighted formats are supported by only one of the two.

Architecture

Nvidia logo A100
Ampere
Nvidia logo A5000
Ampere

Released

11 months newer on A5000
Nvidia logo A100
Q2 2020
Nvidia logo A5000
Q2 2021

Figures are for each model's headline configuration. Where a form factor carries a different number, it is named under the figure.

Source: A100 datasheet and A5000 datasheet.

Price comparison

Cheapest on-demand

5.9x higher on A100
Nvidia logo A100
$0.67 / GPU / hr
Nvidia logo A5000
$0.11 / GPU / hr

Typical rate

1.4x higher on A100
Nvidia logo A100
$1.68 / GPU / hr
Nvidia logo A5000
$1.24 / GPU / hr

Median across providers, one vote each, so a large catalog does not outweigh a small one.

Spot floor

1.1x higher on A100
Nvidia logo A100
$0.13 / GPU / hr
Nvidia logo A5000
$0.12 / GPU / hr

Full price range

Nvidia logo A100
$0.13 - $5.04 / GPU / hr
Nvidia logo A5000
$0.11 - $1.56 / GPU / hr

Lowest to highest listing per GPU-hour, across on-demand, spot, reserved and custom.

Providers listing it

31 more on A100
Nvidia logo A100
42
Nvidia logo A5000
11

Price, last 90 days

Nvidia logo A100
+2%
Nvidia logo A5000
Too volatile to report

Change in the market-wide median, which moves when providers reprice and when cheaper or more expensive listings enter the market.

Heads up: Prices are estimates from published rates for common setups and vary by region and usage; verify with the provider before provisioning.

Offers and availability

How this list works

Order

Each provider appears once per GPU. We pick the one configuration that speaks for that provider, and rank on it in this order:

  1. Availability: in stock, then waitlist, then not reported, then out of stock. A price you can act on outranks a cheaper one you cannot.
  2. Billing type: on-demand first, then reserved, then spot, then quote-only. On-demand leads because it is the only rate you can hold without committing to anything.
  3. Price: the lowest per-GPU hourly rate the provider lists, converted to USD.

The configuration we pick is chosen the same way, availability before billing before price. The rest of that provider's configurations are on the GPU's own page.

Ties sort alphabetically. Reserved rates are not separated by term length, so a three-year commitment can sit above a one-month one: the label beneath each price says which you are looking at. Providers who publish no rate are listed last within their group.

Transparency and funding

  • Ads and sponsors: Paid placements sit at the top of the list and are always labeled as sponsored content. Sponsorship never influences the organic ranking itself.
  • Affiliates: Affiliate links are marked. We may earn a commission if you click them, but commissions never affect the order.
  • Prices: Shown in USD, converted at daily reference rates where a provider publishes in another currency. A month means 720 hours. How we estimate costs.

Similar GPUs

Other comparisons in the same class:

View all GPUs

Our data for Nvidia A100 was last updated on Aug. 26, 2026, and for Nvidia A5000 on Aug. 26, 2026.