AMD MI350X

AMD MI350X

Air-cooled CDNA 4 accelerator for standard data center racks.

Arch
CDNA 4
Memory
288 GB HBM3e
Bandwidth
8.00 TB/s
Released
Q2 2025
Compare with another GPU

Price history

Weekly median price per GPU per hour

Last 4 weeks
Aggregating historical prices...

At a glance Updated 1 hour ago

Cheapest in stock
--
Median price (current)
--
90-day trend
--
Coverage
1 provider
2 price points

Pricing & availability

How this list works

The two views

By provider shows one card per company, placed where its best offer ranked. By configuration lists every offer.

Order

What you can rent comes first: in stock, then waitlist, then not reported, then out of stock. Priced offers rank ahead of quote-only, and on-demand ahead of other billing types.

Within a group, five factors set the order:

  1. Location: datacenter proximity, blended with provider HQ.
  2. Price: hourly price, per GPU and in total.
  3. Billing type: reserved ahead of spot, spot ahead of quote-only.
  4. Specs: more VRAM, vCPUs and RAM.
  5. Provider diversity: a provider's repeat rows rank slightly lower, so one company can't take all the top spots.

Search

We match the provider, its country, GPU model, form factor, billing type, availability and instance name. Matching is partial and case-insensitive. Everyday words work too, so "interruptible" finds spot and "sold out" finds out of stock.

Transparency and funding

  • Ads and sponsors: Paid placements sit at the top of the list and are always labeled as sponsored content. Sponsorship never influences the organic ranking itself.
  • Affiliates: Affiliate links are marked. We may earn a commission if you click them, but commissions never affect the order.
  • Prices: Shown in USD, converted at daily reference rates where a provider publishes in another currency. A month means 720 hours. How we estimate costs.
DigitalOcean logo

DigitalOcean

United States of America flag USA 2 configs 1x-8x

Reserved
from $4.76
Spot
from $4.00
From $4.76 /GPU/hr Reserved (12mo)
Visit website

Heads up: A provider's own page may quote a different figure, for example on tax, region or a promotion. A monthly-only plan shows a derived hourly rate. Verify before provisioning. More on how we price.

What can the MI350X run?

One MI350X has 288 GB of VRAM. In practice, that's enough memory for roughly 460B parameters at 4-bit or 125B at 16-bit, assuming a 32K context. Below are some open-weight LLMs, with the estimated memory and GPUs each one needs.

Fits on 1 Multi-node
Model Memory (INT4 / FP4) MI350Xs needed Cost /hr Cost /mo
Alibaba Cloud logo Qwen3.8-27B 27B
18 GB
1
–
–
Google Cloud logo Gemma 4 31B 30.7B
22 GB
1
–
–
OpenAI logo GPT-OSS-120B 117B · 5.1B active
67 GB
1
–
–
Z.AI logo GLM-5.3-Flash 320B · 18B active
178 GB
1
–
–
MiniMax logo MiniMax-M3 428B · 23B active
239 GB
1
–
–
DeepSeek logo DeepSeek V4.1 Flash 552B · 16B active
306 GB
2
–
–
Moonshot AI logo Kimi K3 2.8T · 104B active
1,544 GB
6
–
–

Estimates based on the median on-demand rate. Memory is weights plus FP8 KV cache at 32K context per request (FP16/BF16 in the 16-bit column). GPU counts assume 90% of advertised VRAM is usable. No guarantee of runtime support, usable performance, or that a matching quantized build exists. How we estimate costs.

Technical Specifications

AMD MI350X · Per GPU

Compute · dense
FP4 9,227.5 TFLOPS
FP8 4,614 TFLOPS 9,227.4 with sparsity
FP16 / BF16 2,309.6 TFLOPS 4,619.2 with sparsity
INT8 4,614 TOPS 9,227.4 with sparsity
FP32 144.2 TFLOPS
FP64 72.1 TFLOPS
Precision support FP4FP6FP8FP16BF16FP32FP64INT8
Memory
Capacity 288 GB HBM3e
Bandwidth 8,000 GB/s
Bus width 8,192-bit
ECC Yes
Silicon
Architecture CDNA 4
Process TSMC 3nm / 6nm FinFET
Transistors 185 billion
Shader cores 16,384 Stream processors
Matrix cores 1,024
Compute units 256
Fabric and host
GPU interconnect Infinity Fabric 1,075 GB/s
Host interface PCIe 5.0 x16
Power
Board power 1,000 W
Cooling Passive
Platform
Partitioning Up to 8 partitions

Source: official AMD MI350X datasheet.

Frequently Asked Questions

How much does the MI350X cost per hour?

As of September 18, 2026, we track 2 configs from 1 provider, none of them on demand. Prices are per GPU per hour.

Billing typeConfigsCheapest

Reserved

1

$4.76 (12 mo)

Spot

1

$4.00

No median for reserved and spot: we only show this when at least 3 providers list the GPU on that billing type.

Where can I rent an MI350X?

GetDeploying currently tracks MI350X configs from 1 provider. See the full price comparison above for every provider and config.

How many MI350X GPUs do I need?

One MI350X runs models up to roughly 460B parameters at 4-bit quantization or 125B at 16-bit, assuming a 32K context. Larger models run across multiple GPUs: the model table above shows the estimated memory and GPU count for popular open-weight LLMs.

Why choose the MI350X?

288GB HBM3e with MXFP6 and MXFP4 support on CDNA 4, in a passive OAM module at 1000W that drops into air-cooled racks. The same memory and bandwidth as the MI355X without a liquid loop.

When is the MI350X not a good fit?

Clocked lower and held to a smaller power envelope than the MI355X, which returns more throughput per GPU where direct liquid cooling is available. The ROCm software stack, while rapidly improving, is narrower than CUDA, so check framework support first.

Alternatives to AMD MI350X

Browse all GPUs

Last updated

Back to top ↑