Overview

Nvidia logo Nvidia H100

The Nvidia H100 is a data center GPU on the Hopper architecture, released Q3 2022, with 80 GB HBM3 and 3,350 GB/s memory bandwidth on the SXM variant.

High Performance Datacenter

Nvidia logo Nvidia RTX 4090

The Nvidia RTX 4090 is a consumer GPU on the Ada Lovelace architecture, released Q4 2022, with 24 GB GDDR6X and 1,010 GB/s memory bandwidth.

Mid-Range Consumer

Memory per GPU

3.3x more on H100
Nvidia logo H100
80 GB HBM3 94 GB on NVL
Nvidia logo RTX 4090
24 GB GDDR6X

Memory bandwidth

3.3x higher on H100
Nvidia logo H100
3,350 GB/s 2,000 GB/s on PCIe 3,900 GB/s on NVL
Nvidia logo RTX 4090
1,010 GB/s

GPU interconnect

Nvidia logo H100
NVLink 900 GB/s NVLink 600 GB/s on PCIe, NVL
Nvidia logo RTX 4090
PCIe only

Peak performance (FP8)

6x higher on H100
Nvidia logo H100
1,979 TFLOPS
Nvidia logo RTX 4090
330.3 TFLOPS

Vendor peak figures, dense and per GPU. Not measured throughput.

FP8 per watt

3.9x higher on H100
Nvidia logo H100
2.83 TFLOPS/W
Nvidia logo RTX 4090
0.73 TFLOPS/W

Board power

1.6x higher on H100
Nvidia logo H100
700 W
Nvidia logo RTX 4090
450 W

Precision support

Nvidia logo H100
FP8 FP16 BF16 TF32 FP32 FP64 INT8
Nvidia logo RTX 4090
FP8 FP16 BF16 TF32 FP32 INT4 INT8

Highlighted formats are supported by only one of the two.

Architecture

Nvidia logo H100
Hopper
Nvidia logo RTX 4090
Ada Lovelace

Released

Nvidia logo H100
Q3 2022
Nvidia logo RTX 4090
Q4 2022

Figures are for each model's headline configuration. Where a form factor carries a different number, it is named under the figure.

Source: H100 datasheet and RTX 4090 datasheet.

Price comparison

Cheapest on-demand

11x higher on H100
Nvidia logo H100
$1.73 / GPU / hr
Nvidia logo RTX 4090
$0.16 / GPU / hr

Typical rate

7.9x higher on H100
Nvidia logo H100
$3.39 / GPU / hr
Nvidia logo RTX 4090
$0.43 / GPU / hr

Median across providers, one vote each, so a large catalog does not outweigh a small one.

Spot floor

2.9x higher on H100
Nvidia logo H100
$0.35 / GPU / hr
Nvidia logo RTX 4090
$0.12 / GPU / hr

Providers listing it

38 more on H100
Nvidia logo H100
54
Nvidia logo RTX 4090
16

Price, last 90 days

Nvidia logo H100
+12%
Nvidia logo RTX 4090
−14%

Change in the market-wide median, which moves when providers reprice and when cheaper or more expensive listings enter the market.

Heads up: Prices are estimates from published rates for common setups and vary by region and usage; verify with the provider before provisioning.

Offers and availability

How this list works

Order

Each provider appears once per GPU. We pick the one configuration that speaks for that provider, and rank on it in this order:

  1. Availability: in stock, then waitlist, then not reported, then out of stock. A price you can act on outranks a cheaper one you cannot.
  2. Billing type: on-demand first, then reserved, then spot, then quote-only. On-demand leads because it is the only rate you can hold without committing to anything.
  3. Price: the lowest per-GPU hourly rate the provider lists, converted to USD.

The configuration we pick is chosen the same way, availability before billing before price. The rest of that provider's configurations are on the GPU's own page.

Ties sort alphabetically. Reserved rates are not separated by term length, so a three-year commitment can sit above a one-month one: the label beneath each price says which you are looking at. Providers who publish no rate are listed last within their group.

Transparency and funding

  • Ads and sponsors: Paid placements sit at the top of the list and are always labeled as sponsored content. Sponsorship never influences the organic ranking itself.
  • Affiliates: Affiliate links are marked. We may earn a commission if you click them, but commissions never affect the order.
  • Prices: Shown in USD, converted at daily reference rates where a provider publishes in another currency. A month means 720 hours. How we estimate costs.

Similar GPUs

Other comparisons in the same class:

View all GPUs

Our data for Nvidia H100 was last updated on Aug. 30, 2026, and for Nvidia RTX 4090 on Aug. 30, 2026.