Key Specifications
Compare Cloud Provider Prices
With a spread of only 11%, price optimization yields diminishing returns for the MI325X. The market is relatively flat, with the lowest rate sitting at $2.00/hr per GPU (36-month reservation).
How we sort results
Default ranking
Our algorithm weighs five factors to find the most relevant matches for you:
- Price: We blend total hourly price with price-per-GPU to balance affordability and value.
- Specs: We favor offers with higher CPU, RAM, and GPU Memory.
- Billing: We favor on-demand billing for simplicity and flexibility over spot instances, reservations, and custom quotes.
- Location: We blend both datacenter proximity and provider HQ location. Datacenter location matters for latency, while HQ location matters for compliance and support.
- Provider diversity: Each time a provider appears in the list, their subsequent offerings are ranked a little lower, so one provider's offerings don't crowd out the top positions.
Sorting and filtering
Click any column header to sort by that column. Use the filters above the table to narrow results by billing type, GPU count, vCPUs, or RAM. Custom sorting resets the default relevance ranking.
Transparency and funding
Ads and sponsors: Any paid placements are fixed at the top and clearly labeled as sponsored content.
Affiliates: Any affiliate links will be indicated to you as well. We may earn a commission if you click them, but this never influences the ranking order.
| Provider | GPUs | Total VRAM | vCPUs | RAM | Billing | $/GPU/h | Total/h | Availability | |
|---|---|---|---|---|---|---|---|---|---|
Vultr
|
8x MI325X 8x MI325X 256GB | 2.0TB | 128 | 3TB | Reserved (36mo) Reserved capacity with a 3-year minimum commitment. | $2.00 | $16.00 | Unknown | View |
DigitalOcean
|
8x MI325X SXM 8x MI325X 256GB SXM | 2.0TB | -- | -- | Reserved (12mo) Reserved capacity with a 1-year minimum commitment. | $2.10 | $16.80 | Unknown | View |
TensorWave
|
8x MI325X 8x MI325X 256GB | 2.0TB | -- | -- | Custom Custom terms negotiated with the provider. | $2.25 | $18.00 | Unknown | View |
| No offerings matching your filters. | |||||||||
Heads up: We do our best to keep these specs & prices accurate. However, cloud costs may fluctuate based on region, usage, and other factors not listed here. These are estimates based on common setups and are for informational purposes only. Always verify current rates & exact specs with the provider before provisioning.
Frequently Asked Questions
Why choose the MI325X?
288GB HBM3e with 6 TB/s bandwidth. Largest VRAM available for serving massive models without sharding. FP8 support for efficient inference.
When is the MI325X not a good fit?
Very limited cloud availability. ROCm ecosystem, while rapidly improving, may have gaps that affect compatibility with some training frameworks. Consider Nvidia alternatives if CUDA compatibility is required.
Are MI325X prices going up or down?
On-demand pricing has decreased by about 33% since July 2025, dropping from $3.43 to $2.29/hr per GPU.
What size AI models can the MI325X run?
With 256GB of VRAM, the MI325X can usually run 70B-class models with headroom, and may handle much larger models in 4-bit quantized form depending on runtime overhead, KV cache, and context length.
How much VRAM does the MI325X have?
The MI325X has 256GB of VRAM. Multi-GPU setups increase total memory, but that memory is not automatically pooled across GPUs.
What is the MI325X's memory bandwidth?
The MI325X has 6,000 GB/s of memory bandwidth. Higher bandwidth helps with faster data transfer between GPU memory and compute cores.
What data types does the MI325X support?
The MI325X supports 6 precision formats. Training: BF16, FP16, FP32. Inference: FP8, INT8. Scientific: FP64.
Does the MI325X support Infinity Fabric?
Yes. The MI325X supports Infinity Fabric with 896 GB/s of bidirectional bandwidth. This helps accelerate multi-GPU communication.
How much does the MI325X cost per hour?
MI325X pricing currently ranges from $2.00/hr to $2.25/hr per GPU, depending on the provider, instance type, and billing model.
How much does the MI325X cost per month?
At 720 hours per month, one MI325X can cost between $1,440.00 to $1,620.00 per month, depending on the provider. Reserved and spot pricing can lower that further.
Which cloud providers offer the MI325X?
The MI325X is available from 3 cloud providers: DigitalOcean, TensorWave, Vultr.
Can I rent the MI325X in the cloud?
Yes. We currently track 3 MI325X listings across 3 cloud providers:
Billing type Listings Avg $/GPU/hr Reserved 2 $2.05/hr Custom contract 1 $2.25/hr
Technical Specifications
| Memory Capacity | Up to 256 GB HBM3E |
| Memory Bandwidth | 6 TB/s max. peak theoretical |
| FP16/BFLOAT16 Performance | 2614.9 TFLOPs (with sparsity) |
| FP8/INT8 Performance | 5229.8 TFLOPs/TOPS (with sparsity) |
| TF32 Performance | 1307.4 TFLOPs (with sparsity) |
| FP64 Matrix Performance | 163.4 TFLOPs |
| Matrix Cores | 1216 |
| GPU Compute Units | 304 |
| Host & Network I/O (Scale-Out) | PCIe® Gen 5 x16 (128 GB/s) |
| Maximum Power Consumption | 1000W (TBP) |
Source: official AMD MI325X datasheet.
Alternatives to AMD MI325X
Last updated