Key Specifications
Compare Cloud Provider Prices
Listings for the MI300X reach $7.86/hr, often reflecting a premium for high availability. However, you might be able to find available instances from as low as $0.95/hr per GPU (spot instance).
How we sort results
Default ranking
Our algorithm weighs five factors to find the most relevant matches for you:
- Price: We blend total hourly price with price-per-GPU to balance affordability and value.
- Specs: We favor offers with higher CPU, RAM, and GPU Memory.
- Billing: We favor on-demand billing for simplicity and flexibility over spot instances, reservations, and custom quotes.
- Location: We blend both datacenter proximity and provider HQ location. Datacenter location matters for latency, while HQ location matters for compliance and support.
- Provider diversity: Each time a provider appears in the list, their subsequent offerings are ranked a little lower, so one provider's offerings don't crowd out the top positions.
Sorting and filtering
Click any column header to sort by that column. Use the filters above the table to narrow results by billing type, GPU count, vCPUs, or RAM. Custom sorting resets the default relevance ranking.
Transparency and funding
Ads and sponsors: Any paid placements are fixed at the top and clearly labeled as sponsored content.
Affiliates: Any affiliate links will be indicated to you as well. We may earn a commission if you click them, but this never influences the ranking order.
| Provider | GPUs | Total VRAM | vCPUs | RAM | Billing | $/GPU/h | Total/h | Availability | |
|---|---|---|---|---|---|---|---|---|---|
Runpod
Our sponsor
|
1x MI300X 1x MI300X 192GB (secure-cloud) | 192GB | 24 | 120GB | On-Demand Pay-as-you-go pricing. No term commitments. | $2.19 | $2.19 | Available | View |
DigitalOcean
|
1x MI300X 1x MI300X 192GB (gpu-mi300x1-192gb) | 192GB | 20 | 240GB | On-Demand Pay-as-you-go pricing. No term commitments. | $1.99 | $1.99 | Unknown | View |
Hot Aisle
|
1x MI300X 1x MI300X 192GB | 192GB | 13 | 224GB | On-Demand Pay-as-you-go pricing. No term commitments. | $1.99 | $1.99 | Unknown | View |
|
Hot Aisle
|
1x MI300X 1x MI300X 192GB | 192GB | 8 | 224GB | On-Demand Pay-as-you-go pricing. No term commitments. | $1.99 | $1.99 | Unknown | View |
Crusoe
|
8x MI300X 8x MI300X 192GB (mi300x-192gb-ib.8x) | 1.5TB | 240 | 2TB | On-Demand Pay-as-you-go pricing. No term commitments. | $3.45 | $27.60 | Unknown | View |
|
Hot Aisle
|
2x MI300X 2x MI300X 192GB | 384GB | 26 | 448GB | On-Demand Pay-as-you-go pricing. No term commitments. | $1.99 | $3.98 | Unknown | View |
|
Hot Aisle
|
4x MI300X 4x MI300X 192GB | 768GB | 52 | 896GB | On-Demand Pay-as-you-go pricing. No term commitments. | $1.99 | $7.96 | Unknown | View |
Vultr
|
8x MI300X 8x MI300X 192GB | 1.5TB | 128 | 2TB | Reserved (24mo) Reserved capacity with a 24-month minimum commitment. | $1.85 | $14.80 | Unknown | View |
|
Runpod
|
1x MI300X 1x MI300X 192GB (secure-cloud) | 192GB | 24 | 120GB | Reserved (12mo) Reserved capacity with a 1-year minimum commitment. | $1.66 | $1.66 | Available | View |
Azure
|
8x MI300X 8x MI300X 192GB (NDMI300Xv5 Srs) | 1.5TB | 96 | 1.9TB | Spot Variable spot pricing with potential interruptions. | $1.45 | $11.62 | Available | View |
|
Crusoe
|
8x MI300X 8x MI300X 192GB (mi300x-192gb-ib.8x (Spot)) | 1.5TB | 240 | 2TB | Spot Variable spot pricing with potential interruptions. | $0.95 | $7.60 | Unknown | View |
|
Runpod
|
1x MI300X 1x MI300X 192GB (secure-cloud) | 192GB | 24 | 120GB | Reserved (6mo) Reserved capacity with a 6-month minimum commitment. | $1.75 | $1.75 | Available | View |
Cirrascale
|
8x MI300X 8x MI300X 192GB | 1.5TB | 96 | 2.4TB | Reserved (12mo) 12-month contract: $17,999/month | $3.12 | $24.99 | Unknown | View |
Oracle Cloud
|
8x MI300X 8x MI300X 192GB (BM.GPU.MI300X.8) | 1.5TB | -- | -- | On-Demand Pay-as-you-go pricing. No term commitments. | $6.00 | $48.00 | Unknown | View |
|
DigitalOcean
|
8x MI300X 8x MI300X 192GB | 1.5TB | -- | -- | Reserved (12mo) Reserved capacity with a 1-year minimum commitment. | $1.88 | $15.04 | Unknown | View |
|
Runpod
|
1x MI300X 1x MI300X 192GB (secure-cloud) | 192GB | 24 | 120GB | Reserved (3mo) Reserved capacity with a 3-month minimum commitment. | $1.86 | $1.86 | Available | View |
|
Cirrascale
|
8x MI300X 8x MI300X 192GB | 1.5TB | 96 | 2.4TB | Reserved (6mo) 6-month contract: $20,249/month | $3.52 | $28.12 | Unknown | View |
|
Azure
|
8x MI300X 8x MI300X 192GB (NDMI300Xv5 Srs) | 1.5TB | 96 | 1.9TB | On-Demand Pay-as-you-go pricing. No term commitments. | $7.86 | $62.85 | Available | View |
|
Runpod
|
1x MI300X 1x MI300X 192GB (secure-cloud) | 192GB | 24 | 120GB | Spot Variable spot pricing with potential interruptions. | $1.99 | $1.99 | Available | View |
|
Cirrascale
|
8x MI300X 8x MI300X 192GB | 1.5TB | 96 | 2.4TB | Reserved (3mo) 3-month contract: $21,379/month | $3.71 | $29.69 | Unknown | View |
| No offerings matching your filters. | |||||||||
Heads up: We do our best to keep these specs & prices accurate. However, cloud costs may fluctuate based on region, usage, and other factors not listed here. These are estimates based on common setups and are for informational purposes only. Always verify current rates & exact specs with the provider before provisioning.
Frequently Asked Questions
Why choose the MI300X?
Comes with 192GB HBM3 - the largest memory of any single GPU. 5.3 TB/s memory bandwidth. Strong ROCm ecosystem for PyTorch workloads. Competitive pricing against H100 for inference.
When is the MI300X not a good fit?
ROCm software ecosystem, while rapidly improving, is narrower than CUDA. Some frameworks and libraries may have limited AMD support. Multi-node training tooling is less mature than Nvidia's.
Are MI300X prices going up or down?
On-demand pricing has increased by about 33% since June 2025, from $2.35 to $3.12/hr per GPU.
What size AI models can the MI300X run?
With 192GB of VRAM, the MI300X can usually run 70B-class models with headroom, and may handle much larger models in 4-bit quantized form depending on runtime overhead, KV cache, and context length.
How much VRAM does the MI300X have?
The MI300X has 192GB of VRAM. Multi-GPU setups increase total memory, but that memory is not automatically pooled across GPUs.
What is the MI300X's memory bandwidth?
The MI300X has 5,300 GB/s of memory bandwidth. Higher bandwidth helps with faster data transfer between GPU memory and compute cores.
What data types does the MI300X support?
The MI300X supports 6 precision formats. Training: BF16, FP16, FP32. Inference: FP8, INT8. Scientific: FP64.
Does the MI300X support Infinity Fabric?
Yes. The MI300X supports Infinity Fabric with 896 GB/s of bidirectional bandwidth. This helps accelerate multi-GPU communication.
How much does the MI300X cost per hour?
MI300X pricing currently ranges from $0.95/hr to $7.86/hr per GPU, depending on the provider, instance type, and billing model.
How much does the MI300X cost per month?
At 720 hours per month, one MI300X can cost between $684.00 to $5,656.77 per month, depending on the provider. Reserved and spot pricing can lower that further.
Which cloud providers offer the MI300X?
The MI300X is available from 9 cloud providers, including Runpod, Cirrascale, Crusoe. Pricing and availability vary by region and billing model.
Can I rent the MI300X in the cloud?
Yes. We currently track 24 MI300X listings across 9 cloud providers:
Billing type Listings Avg $/GPU/hr On-demand 9 $3.27/hr Reserved 11 $2.73/hr Spot 3 $1.46/hr Custom contract 1 Custom
Technical Specifications
| TF32 (TFLOPs) | 653.7 |
| FP16 (TFLOPs) | 1307.4 |
| BFLOAT16 (TFLOPs) | 1307.4 |
| INT8 (TOPS) | 2614.9 |
| FP8 (TFLOPs) | 2614.9 |
| FP64 vector | 81.7 |
| FP32 vector | 163.4 |
| FP64 matrix | 163.4 |
| FP32 matrix | 163.4 |
| Decoders | 4 groups for HEVC/H.265, AVC/H.264, V1, or AV1 |
| JPEG/MJPEG CODEC | 32 cores, 8 cores per group |
| Virtualization support | SR-IOV, up to 8 partitions |
| Form factor | OAM module |
| Lithography | 5nm FinFET, 6nm FinFET |
| GPU compute units | 304 |
| Matrix cores | 1216 |
| Stream processors | 19,456 |
| Peak engine clock | 2100 MHz |
| Memory capacity | Up to 192 GB HBM3 |
| Memory bandwidth | 5.3 TB/s max. peak theoretical |
| Memory interface | 8192 bits |
| AMD Infinity Cache™ (last level) | 256 MB |
| Memory clock | Up to 5.2 GT/s |
| Scale-up Infinity Fabric™ Links | 7x 128 GB/s |
| I/O to host CPU | 1 PCIe® Gen 5 x16 (128 GB/s) |
| Scale-out network bandwidth | PCIe Gen 5 x16 (128 GB/s) |
| RAS features | Full-chip ECC memory, page retirement, page avoidance |
| Maximum TBP | 750W |
Source: official AMD MI300X datasheet.
Alternatives to AMD MI300X
Last updated