Intel Gaudi2
vs
Nvidia RTX 3080 Ti
A data center GPU against a consumer card, one Gaudi (2nd Gen) and one Ampere: 96 GB HBM2e against 12 GB GDDR6X, 2.7x the memory bandwidth on the Gaudi2, and RoCE 600 GB/s on the Gaudi2 where the RTX 3080 Ti is PCIe only.
At a glance
Memory
- Gaudi2
- 96 GB
- RTX 3080 Ti
- 12 GB
8x more on Gaudi2
Memory bandwidth
- Gaudi2
- 2,450 GB/s
- RTX 3080 Ti
- 912 GB/s
2.7x higher on Gaudi2
Cheapest on-demand
- Gaudi2
- $1.03 /GPU/hr
- RTX 3080 Ti
- $0.15 /GPU/hr
6.6x more expensive on Gaudi2
Price comparison
Median price per GPU per hour by billing type, with the cheapest listing under it.
| Billing | Gaudi2 | RTX 3080 Ti | Difference |
|---|---|---|---|
| On-demand | $1.21 /GPU/hr from $1.03 | -- /GPU/hr from $0.15 | |
| Reserved | -- /GPU/hr from $0.58 (12 mo) | No reserved listings | |
| Spot | No spot listings | -- /GPU/hr from $0.08 |
Heads up: A provider's own page may quote a different figure, for example on tax, region or a promotion. A monthly-only plan shows a derived hourly rate. Medians are across providers, one vote each, so a large catalog does not outweigh a small one. No median for reserved on the Gaudi2 and on-demand and spot on the RTX 3080 Ti: we only show one when at least 3 providers list the GPU on that billing type. Verify before provisioning. More on how we price.
Price history
Gaudi2 vs RTX 3080 Ti price history
Weekly median on-demand price per GPU per hour
Specs comparison
| Spec | Gaudi2 | RTX 3080 Ti | Difference |
|---|---|---|---|
| Memory | |||
| Capacity | 96 GB HBM2e | 12 GB GDDR6X | 8x more on Gaudi2 |
| Bandwidth | 2,450 GB/s | 912 GB/s | 2.7x higher on Gaudi2 |
| Bus width | 384-bit | ||
| Compute · dense | |||
| FP8 | 865 TFLOPS | Not supported | Gaudi2 only |
| FP16 / BF16 | 432 TFLOPS | 68.2 TFLOPS | 6.3x higher on Gaudi2 |
| INT8 | 272.8 TOPS | ||
| FP32 | 34.1 TFLOPS | ||
| Platform | |||
| Interconnect | RoCE 600 GB/s | PCIe only | RoCE on Gaudi2 only |
| Board power | 600 W | 350 W | 1.7x higher on Gaudi2 |
| Released | Q2 2022 | Q2 2021 | 11 months newer on Gaudi2 |
| Precision | |||
| Supported formats | FP8FP16BF16TF32FP32INT8 | FP16BF16TF32FP32INT4INT8 | |
Compute: Vendor peak figures, dense and per GPU. Not measured throughput.
Source: Gaudi2 datasheet and RTX 3080 Ti datasheet.
Where to rent them
Providers listing these GPUs, those with both first, so you can switch without moving clouds.
Similar GPUs
Other comparisons in the same class.
-
Nvidia H100
From $1.45 /GPU/hr Compare -
Nvidia A100
From $0.80 /GPU/hr Compare -
AMD MI300X
From $2.39 /GPU/hr Compare -
Nvidia RTX 3090
From $0.10 /GPU/hr Compare -
Nvidia RTX 3080
From $0.14 /GPU/hr Compare
Our data for Intel Gaudi2 was last updated on Sept. 7, 2026, and for Nvidia RTX 3080 Ti on Sept. 7, 2026.