Overview

Nvidia logo Nvidia RTX A2000

The Nvidia RTX A2000 is a workstation GPU on the Ampere architecture, released Q3 2021, with 12 GB GDDR6 and 288 GB/s memory bandwidth.

Budget Workstation

Nvidia logo Nvidia GH200

The Nvidia GH200 is a data center GPU on the Grace Hopper architecture, released Q2 2023, with 96 GB HBM3 and 4,000 GB/s memory bandwidth.

High Performance Datacenter

Memory per GPU

8x more on GH200
Nvidia logo RTX A2000
12 GB GDDR6
Nvidia logo GH200
96 GB HBM3

Memory bandwidth

14x higher on GH200
Nvidia logo RTX A2000
288 GB/s
Nvidia logo GH200
4,000 GB/s

GPU interconnect

Nvidia logo RTX A2000
PCIe only
Nvidia logo GH200
NVLink 900 GB/s

Peak performance (FP16)

31x higher on GH200
Nvidia logo RTX A2000
31.9 TFLOPS
Nvidia logo GH200
989.5 TFLOPS

Vendor peak figures, dense and per GPU. Not measured throughput.

Precision support

Nvidia logo RTX A2000
FP16 BF16 TF32 FP32 INT4 INT8
Nvidia logo GH200
FP8 FP16 BF16 TF32 FP32 FP64 INT8

Highlighted formats are supported by only one of the two.

Architecture

Nvidia logo RTX A2000
Ampere
Nvidia logo GH200
Grace Hopper

Released

2 years newer on GH200
Nvidia logo RTX A2000
Q3 2021
Nvidia logo GH200
Q2 2023

Figures are for each model's headline configuration. Where a form factor carries a different number, it is named under the figure.

Source: RTX A2000 datasheet and GH200 datasheet.

Price comparison

Cheapest on-demand

125x higher on GH200
Nvidia logo RTX A2000
$0.05 / GPU / hr
Nvidia logo GH200
$6.50 / GPU / hr

Typical rate

16x higher on GH200
Nvidia logo RTX A2000
$0.42 / GPU / hr
Nvidia logo GH200
$6.50 / GPU / hr

Median across providers, one vote each, so a large catalog does not outweigh a small one.

Providers listing it

1 more on GH200
Nvidia logo RTX A2000
3
Nvidia logo GH200
4

Heads up: A provider's own page may quote a different figure, for example on tax, region or a promotion. A monthly-only plan shows a derived hourly rate. Verify before provisioning. More on how we price.

Offers and availability

How this list works

Order

Each provider appears once per GPU. We pick the one configuration that speaks for that provider, and rank on it in this order:

  1. Availability: in stock, then waitlist, then not reported, then out of stock. A price you can act on outranks a cheaper one you cannot.
  2. Billing type: on-demand first, then reserved, then spot, then quote-only. On-demand leads because it is the only rate you can hold without committing to anything.
  3. Price: the lowest per-GPU hourly rate the provider lists, converted to USD.

The configuration we pick is chosen the same way, availability before billing before price. The rest of that provider's configurations are on the GPU's own page.

Ties sort alphabetically. Reserved rates are not separated by term length, so a three-year commitment can sit above a one-month one: the label beneath each price says which you are looking at. Providers who publish no rate are listed last within their group.

Transparency and funding

  • Ads and sponsors: Paid placements sit at the top of the list and are always labeled as sponsored content. Sponsorship never influences the organic ranking itself.
  • Affiliates: Affiliate links are marked. We may earn a commission if you click them, but commissions never affect the order.
  • Prices: Shown in USD, converted at daily reference rates where a provider publishes in another currency. A month means 720 hours. How we estimate costs.

Similar GPUs

Other comparisons in the same class:

View all GPUs

Our data for Nvidia RTX A2000 was last updated on Sept. 7, 2026, and for Nvidia GH200 on Sept. 7, 2026.