USA
3 configs
1x-8x
Weekly median price per GPU per hour. AMD MI325X price history (JSON).
At a glance
Hardware
- Architecture
- CDNA 3
- Memory per GPU
- 256 GB HBM3e
- Memory bandwidth
- 6,000 GB/s
- Release date
- Q4 2024
Market Updated 7 minutes ago
- Cheapest
- $2.25 / GPU / hr
- on-demand · not verified in stock
- Median price
- $3.10 / GPU / hr
- on-demand
- Coverage
- 5 providers
- 23 configs · none verified in stock
MI325X Pricing and Availability
USA
2 configs
8x
India
16 configs
1x-8x
USA
1 config
8x
Vultr
Out of stock
USA
1 config
8x
No providers match .
Heads up: A provider's own page may quote a different figure, for example on tax, region or a promotion. A monthly-only plan shows a derived hourly rate. Verify before provisioning. More on how we price.
What size AI models can the MI325X run?
One MI325X has 256 GB of VRAM. In practice, that's enough memory for roughly 408B parameters at 4-bit or 110B at 16-bit, assuming a 32K context. Below are some open-weight LLMs, with the estimated memory and GPUs each one needs.
| Model | Parameters | 4-bitINT4 / FP4 | 8-bitFP8 / INT8 | 16-bitFP16 / BF16 |
|---|---|---|---|---|
|
|
27B
|
1 GPU
18 GB VRAM · $2,232/mo
|
1 GPU
30 GB VRAM · $2,232/mo
|
1 GPU
58 GB VRAM · $2,232/mo
|
|
|
30.7B
|
1 GPU
22 GB VRAM · $2,232/mo
|
1 GPU
35 GB VRAM · $2,232/mo
|
1 GPU
69 GB VRAM · $2,232/mo
|
|
|
117B
5.1B active
|
1 GPU
67 GB VRAM · $2,232/mo
|
1 GPU
120 GB VRAM · $2,232/mo
|
8 GPUs
237 GB VRAM · $17,856/mo
|
|
|
284B
13B active
|
1 GPU
160 GB VRAM · $2,232/mo
|
8 GPUs
287 GB VRAM · $17,856/mo
|
8 GPUs
573 GB VRAM · $17,856/mo
|
|
|
320B
18B active
|
1 GPU
178 GB VRAM · $2,232/mo
|
8 GPUs
322 GB VRAM · $17,856/mo
|
8 GPUs
642 GB VRAM · $17,856/mo
|
|
|
428B
23B active
|
8 GPUs
239 GB VRAM · $17,856/mo
|
8 GPUs
432 GB VRAM · $17,856/mo
|
8 GPUs
862 GB VRAM · $17,856/mo
|
|
|
2.8T
104B active
|
8 GPUs
1,544 GB VRAM · $17,856/mo
|
13 GPUs
2,804 GB VRAM
|
25 GPUs
5,605 GB VRAM
|
Estimates based on the median on-demand rate. Memory is weights plus FP8 KV cache at 32K context per request (FP16/BF16 in the 16-bit column). GPU counts assume 90% of advertised VRAM is usable. No guarantee of runtime support, usable performance, or that a matching quantized build exists. How we estimate costs.
Technical Specifications
AMD MI325X · Per GPU
| Compute · dense | |
|---|---|
| FP8 | 2,614.9 TFLOPS 5,229.8 with sparsity |
| FP16 / BF16 | 1,307.4 TFLOPS 2,614.9 with sparsity |
| INT8 | 2,614.9 TOPS 5,229.8 with sparsity |
| FP32 | 163.4 TFLOPS |
| FP64 | 81.7 TFLOPS |
| Precision support | FP8FP16BF16TF32FP32FP64INT8 |
| Memory | |
|---|---|
| Capacity | 256 GB HBM3e |
| Bandwidth | 6,000 GB/s |
| Bus width | 8,192-bit |
| ECC | Yes |
| Silicon | |
|---|---|
| Architecture | CDNA 3 |
| Process | TSMC 5nm / 6nm FinFET |
| Transistors | 153 billion |
| Shader cores | 19,456 Stream processors |
| Matrix cores | 1,216 |
| Compute units | 304 |
| Fabric and host | |
|---|---|
| GPU interconnect | Infinity Fabric 896 GB/s |
| Host interface | PCIe 5.0 x16 |
| Power | |
|---|---|
| Board power | 1,000 W |
| Cooling | Passive |
| Platform | |
|---|---|
| Partitioning | Up to 8 partitions |
Source: official AMD MI325X datasheet.
Frequently Asked Questions
How much does the MI325X cost per hour?
-
As of September 5, 2026, the median on-demand price is $3.10 per GPU per hour across 3 providers.
Billing type Configs Median / GPU / hr Cheapest in stock On-demand 7 $3.10 $2.25 Reserved 14 $1.95 $1.50 (12 mo) Spot 1 Sold out Custom contract 1 $2.25 No median for custom-contract: we only show this when at least 3 providers list the GPU on that billing type. Custom-contract pricing is negotiated per deal and usually not published.
Who has the cheapest MI325X?
-
As of September 5, 2026, the lowest listed on-demand price for the MI325X is $2.25 per GPU per hour from Bentaus, though we haven't verified current stock.
How much does the MI325X cost per month?
-
As of September 5, 2026, at 720 hours per month, one MI325X costs an estimated $2,232 at the median on-demand price.
Where can I rent an MI325X?
-
GetDeploying currently tracks MI325X configs from 5 providers. See the full price comparison above for every provider and config.
How many MI325X GPUs do I need?
-
One MI325X runs models up to roughly 408B parameters at 4-bit quantization or 110B at 16-bit, assuming a 32K context. Larger models run across multiple GPUs: the model table above shows the estimated memory and GPU count for popular open-weight LLMs.
Why choose the MI325X?
-
256GB HBM3e with 6 TB/s bandwidth. Largest VRAM available for serving massive models without sharding. FP8 support for efficient inference.
When is the MI325X not a good fit?
-
Very limited cloud availability. ROCm ecosystem, while rapidly improving, may have gaps that affect compatibility with some training frameworks. Consider Nvidia alternatives if CUDA compatibility is required.
Alternatives to AMD MI325X
-
Nvidia H100
80 GB HBM3 · 44% less bandwidth than the MI325X
From $1.73 / GPU / hr Compare -
Nvidia B200
180 GB HBM3e · 28% more bandwidth than the MI325X
From $3.75 / GPU / hr Compare -
Nvidia H200
141 GB HBM3e · 20% less bandwidth than the MI325X
From $1.99 / GPU / hr Compare -
AMD MI300X
192 GB HBM3 · released Q4 2023
From $2.59 / GPU / hr Compare
Last updated