Intel Gaudi2
Intel's data center AI accelerator with on-chip Ethernet for cost-efficient scale-out.
Compare vs other GPUs →Key Specifications
Compare Cloud Provider Prices
Listings for the Gaudi2 reach $1.12/hr, often reflecting a premium for high availability. However, you might be able to find available instances from as low as $0.62/hr per GPU (12-month reservation).
How we sort results
Default ranking
Our algorithm weighs five factors to find the most relevant matches for you:
- Price: We blend total hourly price with price-per-GPU to balance affordability and value.
- Specs: We favor offers with higher CPU, RAM, and GPU Memory.
- Billing: We favor on-demand billing for simplicity and flexibility over spot instances, reservations, and custom quotes.
- Location: We blend both datacenter proximity and provider HQ location. Datacenter location matters for latency, while HQ location matters for compliance and support.
- Provider diversity: Each time a provider appears in the list, their subsequent offerings are ranked a little lower, so one provider's offerings don't crowd out the top positions.
Sorting and filtering
Click any column header to sort by that column. Use the filters above the table to narrow results by billing type, GPU count, vCPUs, or RAM. Custom sorting resets the default relevance ranking.
Transparency and funding
Ads and sponsors: Any paid placements are fixed at the top and clearly labeled as sponsored content.
Affiliates: Any affiliate links will be indicated to you as well. We may earn a commission if you click them, but this never influences the ranking order.
| Provider | GPUs | Total VRAM | vCPUs | RAM | Billing | $/GPU/h | Total/h | Availability | |
|---|---|---|---|---|---|---|---|---|---|
Cyfuture AI
|
1x Gaudi2 1x Gaudi2 96GB (1xGaudi2) | 96GB | 19 | 288GB | On-Demand Pay-as-you-go pricing. No term commitments. | $1.12 | $1.12 | Unknown | View |
|
Cyfuture AI
|
2x Gaudi2 2x Gaudi2 96GB (2xGaudi2) | 192GB | 38 | 576GB | On-Demand Pay-as-you-go pricing. No term commitments. | $1.11 | $2.22 | Unknown | View |
|
Cyfuture AI
|
1x Gaudi2 1x Gaudi2 96GB (1xGaudi2) | 96GB | 19 | 288GB | Reserved (12mo) Reserved capacity with a 1-year minimum commitment. | $0.66 | $0.66 | Unknown | View |
|
Cyfuture AI
|
1x Gaudi2 1x Gaudi2 96GB (1xGaudi2) | 96GB | 19 | 288GB | Reserved (6mo) Reserved capacity with a 6-month minimum commitment. | $0.77 | $0.77 | Unknown | View |
|
Cyfuture AI
|
2x Gaudi2 2x Gaudi2 96GB (2xGaudi2) | 192GB | 38 | 576GB | Reserved (12mo) Reserved capacity with a 1-year minimum commitment. | $0.64 | $1.27 | Unknown | View |
|
Cyfuture AI
|
1x Gaudi2 1x Gaudi2 96GB (1xGaudi2) | 96GB | 19 | 288GB | Reserved (1mo) Reserved capacity with a 1-month minimum commitment. | $0.90 | $0.90 | Unknown | View |
|
Cyfuture AI
|
2x Gaudi2 2x Gaudi2 96GB (2xGaudi2) | 192GB | 38 | 576GB | Reserved (6mo) Reserved capacity with a 6-month minimum commitment. | $0.74 | $1.49 | Unknown | View |
|
Cyfuture AI
|
4x Gaudi2 4x Gaudi2 96GB (4xGaudi2) | 384GB | 76 | 1.2TB | On-Demand Pay-as-you-go pricing. No term commitments. | $1.10 | $4.41 | Unknown | View |
|
Cyfuture AI
|
4x Gaudi2 4x Gaudi2 96GB (4xGaudi2) | 384GB | 76 | 1.2TB | Reserved (12mo) Reserved capacity with a 1-year minimum commitment. | $0.63 | $2.51 | Unknown | View |
|
Cyfuture AI
|
2x Gaudi2 2x Gaudi2 96GB (2xGaudi2) | 192GB | 38 | 576GB | Reserved (1mo) Reserved capacity with a 1-month minimum commitment. | $0.89 | $1.78 | Unknown | View |
|
Cyfuture AI
|
4x Gaudi2 4x Gaudi2 96GB (4xGaudi2) | 384GB | 76 | 1.2TB | Reserved (6mo) Reserved capacity with a 6-month minimum commitment. | $0.74 | $2.96 | Unknown | View |
|
Cyfuture AI
|
8x Gaudi2 8x Gaudi2 96GB (8xGaudi2) | 768GB | 152 | 2.3TB | Reserved (12mo) Reserved capacity with a 1-year minimum commitment. | $0.62 | $4.97 | Unknown | View |
|
Cyfuture AI
|
4x Gaudi2 4x Gaudi2 96GB (4xGaudi2) | 384GB | 76 | 1.2TB | Reserved (1mo) Reserved capacity with a 1-month minimum commitment. | $0.88 | $3.51 | Unknown | View |
|
Cyfuture AI
|
8x Gaudi2 8x Gaudi2 96GB (8xGaudi2) | 768GB | 152 | 2.3TB | Reserved (6mo) Reserved capacity with a 6-month minimum commitment. | $0.73 | $5.86 | Unknown | View |
|
Cyfuture AI
|
8x Gaudi2 8x Gaudi2 96GB (8xGaudi2) | 768GB | 152 | 2.3TB | On-Demand Pay-as-you-go pricing. No term commitments. | $1.09 | $8.72 | Unknown | View |
|
Cyfuture AI
|
8x Gaudi2 8x Gaudi2 96GB (8xGaudi2) | 768GB | 152 | 2.3TB | Reserved (1mo) Reserved capacity with a 1-month minimum commitment. | $0.87 | $6.94 | Unknown | View |
| No offerings matching your filters. | |||||||||
Heads up: We do our best to keep these specs & prices accurate. However, cloud costs may fluctuate based on region, usage, and other factors not listed here. These are estimates based on common setups and are for informational purposes only. Always verify current rates & exact specs with the provider before provisioning.
Frequently Asked Questions
Why choose the Gaudi2?
Comes with 96GB HBM2e and 24x 100GbE RoCEv2 ports integrated on-chip, so clusters scale out over standard Ethernet without separate NICs. FP8 support and competitive pricing make it a cost-efficient option for training and inference on the Intel Gaudi software stack.
When is the Gaudi2 not a good fit?
The Gaudi software stack supports fewer frameworks and models than CUDA, so workloads relying on niche libraries may need porting. For broad ecosystem compatibility, H100 or A100 remain easier to adopt.
What size AI models can the Gaudi2 run?
With 96GB of VRAM, the Gaudi2 is well suited to 30B-class models in FP16, and 70B-class models in 4-bit or 8-bit quantized form.
How much VRAM does the Gaudi2 have?
The Gaudi2 has 96GB of VRAM. Multi-GPU setups increase total memory, but that memory is not automatically pooled across GPUs.
What is the Gaudi2's memory bandwidth?
The Gaudi2 has 2,450 GB/s of memory bandwidth. Higher bandwidth helps with faster data transfer between GPU memory and compute cores.
What data types does the Gaudi2 support?
The Gaudi2 supports 6 precision formats. Training: BF16, FP16, TF32, FP32. Inference: FP8, INT8.
Does the Gaudi2 support NVLink?
No. The Gaudi2 is a PCIe-only GPU with no NVLink, so it is better suited to single-GPU inference and smaller-scale workloads than large distributed training jobs.
How much does the Gaudi2 cost per hour?
Gaudi2 pricing currently ranges from $0.62/hr to $1.12/hr per GPU, depending on the provider, instance type, and billing model.
How much does the Gaudi2 cost per month?
At 720 hours per month, one Gaudi2 can cost between $447.30 to $806.40 per month, depending on the provider. Reserved and spot pricing can lower that further.
Which cloud providers offer the Gaudi2?
The Gaudi2 is available from 1 cloud provider: Cyfuture AI.
Can I rent the Gaudi2 in the cloud?
Yes. We currently track 16 Gaudi2 listings across 1 cloud providers:
Billing type Listings Avg $/GPU/hr On-demand 4 $1.11/hr Reserved 12 $0.76/hr
Technical Specifications
| Architecture | Gaudi (2nd Gen) |
| Process | 7nm |
| Memory | 96 GB HBM2E |
| Memory Bandwidth | 2.45 TB/s |
| On-chip SRAM | 48 MB |
| Compute Engines | 2x Matrix Multiplication Engine (MME), 24x Tensor Processor Core (TPC) |
| Networking | 24x 100 GbE RoCEv2 (2,400 Gb/s) |
| Host Interface | PCIe Gen4 x16 |
| Media | Integrated decoders (HEVC, H.264, VP9, JPEG) |
| Supported Data Types | FP32, TF32, BF16, FP16, FP8, INT8 |
| Form Factor | OAM (HL-225H) |
| Max TDP | 600W |
Source: official Intel Gaudi2 datasheet.
Alternatives to Intel Gaudi2
Nvidia H100
NVIDIA's Hopper data center GPU with the CUDA ecosystem and NVLink. From $0.48/hr per GPU across 47 providers.
Nvidia A100
NVIDIA Ampere data center GPU with MIG partitioning. From $0.18/hr per GPU across 40 providers.
AMD MI300X
AMD's flagship data center GPU with 192GB of memory. From $0.95/hr per GPU across 9 providers.
Last updated