Overview

Nvidia logo Nvidia GH200

Grace Hopper superchip combining ARM CPU with H100 GPU.

High Performance Datacenter

Nvidia logo Nvidia RTX 3060

Best budget Ampere option for small model fine-tuning.

Budget Consumer

Memory per GPU

8x more on GH200
Nvidia logo GH200
96 GB HBM3
Nvidia logo RTX 3060
12 GB GDDR6

Memory bandwidth

11x higher on GH200
Nvidia logo GH200
4,000 GB/s
Nvidia logo RTX 3060
360 GB/s

GPU interconnect

Nvidia logo GH200
NVLink 900 GB/s
Nvidia logo RTX 3060
PCIe only

Precision support

Nvidia logo GH200
FP8 FP16 BF16 TF32 FP32 FP64 INT8
Nvidia logo RTX 3060
FP16 BF16 TF32 FP32 INT4 INT8

Highlighted formats are supported by only one of the two.

Architecture

Nvidia logo GH200
Grace Hopper
Nvidia logo RTX 3060
Ampere

Released

2 years newer on GH200
Nvidia logo GH200
Q2 2023
Nvidia logo RTX 3060
Q1 2021

Price comparison

Cheapest on-demand

162x higher on GH200
Nvidia logo GH200
$6.50 / GPU / hr
Nvidia logo RTX 3060
$0.04 / GPU / hr

Typical rate

125x higher on GH200
Nvidia logo GH200
$6.50 / GPU / hr
Nvidia logo RTX 3060
$0.05 / GPU / hr

Median across providers, one vote each, so a large catalog does not outweigh a small one.

Spot floor

Nvidia logo GH200
No spot listings
Nvidia logo RTX 3060
$0.04 / GPU / hr

Full price range

Nvidia logo GH200
$6.50 - $6.50 / GPU / hr
Nvidia logo RTX 3060
$0.04 - $0.09 / GPU / hr

Lowest to highest listing per GPU-hour, across on-demand, spot, reserved and custom.

Providers listing it

Nvidia logo GH200
3
Nvidia logo RTX 3060
3

Heads up: We do our best to keep these specs & prices accurate. However, cloud costs may fluctuate based on region, usage, and other factors not listed here. These are estimates based on common setups and are for informational purposes only. Always verify current rates & exact specs with the provider before provisioning.

Offers and availability

How this list works

Order

Each provider appears once per GPU. We pick the one configuration that speaks for that provider, and rank on it in this order:

  1. Availability: in stock, then waitlist, then not reported, then out of stock. A price you can act on outranks a cheaper one you cannot.
  2. Billing type: on-demand first, then reserved, then spot, then quote-only. On-demand leads because it is the only rate you can hold without committing to anything.
  3. Price: the lowest per-GPU hourly rate the provider lists, converted to USD.

The configuration we pick is chosen the same way, availability before billing before price. The rest of that provider's configurations are on the GPU's own page.

Ties sort alphabetically. Reserved rates are not separated by term length, so a three-year commitment can sit above a one-month one: the label beneath each price says which you are looking at. Providers who publish no rate are listed last within their group.

Transparency and funding

  • Ads and sponsors: Paid placements sit at the top of the list and are always labeled as sponsored content. Sponsorship never influences the organic ranking itself.
  • Affiliates: Affiliate links are marked. We may earn a commission if you click them, but commissions never affect the order.
  • Prices: Shown in USD, converted at daily reference rates where a provider publishes in another currency. A month means 720 hours. How we estimate costs.

Nvidia GH200 logo GH200 Offers

0 of 2 providers report available stock, 1 more publish no status.

Nvidia RTX 3060 logo RTX 3060 Offers

2 of 2 providers report available stock, 1 more publish no status.

Similar GPUs

Other comparisons in the same class:

View all GPUs

Our data for Nvidia GH200 was last updated on Aug. 21, 2026, and for Nvidia RTX 3060 on Aug. 21, 2026.