Overview
AMD MI350X
The AMD MI350X is a data center GPU on the CDNA 4 architecture, released Q2 2025, with 288 GB HBM3e and 8,000 GB/s memory bandwidth.
Nvidia A40
The Nvidia A40 is a data center GPU on the Ampere architecture, released Q4 2020, with 48 GB GDDR6 and 696 GB/s memory bandwidth.
Memory per GPU
6x more on MI350X
MI350X
A40
Memory bandwidth
11x higher on MI350X
MI350X
A40
GPU interconnect
MI350X
A40
Peak performance (FP16)
15x higher on MI350X
MI350X
A40
Vendor peak figures. Sparsity and tensor-core conventions differ between vendors.
Precision support
MI350X
A40
Highlighted formats are supported by only one of the two.
Architecture
MI350X
A40
Released
5 years newer on MI350X
MI350X
A40
Source: MI350X datasheet and A40 datasheet.
Price comparison
Cheapest on-demand
MI350X
A40
Typical rate
10x higher on MI350X
MI350X
A40
Median across providers, one vote each, so a large catalog does not outweigh a small one.
Spot floor
12x higher on MI350X
MI350X
A40
Full price range
MI350X
A40
Lowest to highest listing per GPU-hour, across on-demand, spot, reserved and custom.
Providers listing it
5 more on A40
MI350X
A40
Heads up: Prices are estimates from published rates for common setups and vary by region and usage; verify with the provider before provisioning.
Offers and availability
How this list works
Order
Each provider appears once per GPU. We pick the one configuration that speaks for that provider, and rank on it in this order:
- Availability: in stock, then waitlist, then not reported, then out of stock. A price you can act on outranks a cheaper one you cannot.
- Billing type: on-demand first, then reserved, then spot, then quote-only. On-demand leads because it is the only rate you can hold without committing to anything.
- Price: the lowest per-GPU hourly rate the provider lists, converted to USD.
The configuration we pick is chosen the same way, availability before billing before price. The rest of that provider's configurations are on the GPU's own page.
Ties sort alphabetically. Reserved rates are not separated by term length, so a three-year commitment can sit above a one-month one: the label beneath each price says which you are looking at. Providers who publish no rate are listed last within their group.
Transparency and funding
- Ads and sponsors: Paid placements sit at the top of the list and are always labeled as sponsored content. Sponsorship never influences the organic ranking itself.
- Affiliates: Affiliate links are marked. We may earn a commission if you click them, but commissions never affect the order.
- Prices: Shown in USD, converted at daily reference rates where a provider publishes in another currency. A month means 720 hours. How we estimate costs.
MI350X Offers
No provider publishes a stock status.
A40 Offers
4 of 6 providers report available stock.
Similar GPUs
Other comparisons in the same class:
Our data for AMD MI350X was last updated on Aug. 28, 2026, and for Nvidia A40 on Aug. 26, 2026.