AMD logo Nvidia logo

MI300X vs A100

The MI300X features 192GB for large models, while the A100 offers 80GB with MIG support. Choose MI300X for larger models, A100 for workload partitioning.

Overview

AMD logo AMD MI300X Nvidia logo Nvidia A100
Summary AMD's flagship data center GPU for large-model inference. Previous-gen data center workhorse for AI training and inference.
Architecture CDNA 3 Ampere
Memory 192GB HBM3 40GB / 80GB HBM2e
Memory Bandwidth 5,300 GB/s 1,935 GB/s
Performance 1,307 TFLOPS (FP16) 312 TFLOPS (FP16)
Release Date Q4 2023 Q2 2020
Performance Segment High Performance High Performance
Datasheet Link Link

Price comparison

How we rank providers

Default ranking

Each provider appears once per GPU, ranked on three things in order:

  1. Availability: in stock, then unconfirmed, then waitlist, then out of stock. A price you can act on outranks a cheaper one you cannot.
  2. Billing type: on-demand rates rank ahead of spot and reserved ones. A spot rate is cheaper because it can be reclaimed, and a reserved rate because it is a commitment.
  3. Price: the lowest hourly price a provider charges for a single one of that GPU, with other currencies converted to USD first.

Providers that tie on price are sorted alphabetically.

Reserved rates are not separated by term length, so a multi-year commitment can rank above a one-month one. The term is shown beneath each price.

Transparency and funding

Ads and sponsors: Any paid placements are fixed at the top and labeled as sponsored content.

Affiliates: Any affiliate links will be indicated to you as well. We may earn a commission if you click them, but this never influences the ranking order.

AMD MI300X logo MI300X Pricing

Listings for the MI300X reach $7.86/hr, often reflecting a premium for high availability. However, you might be able to find available instances from as low as $1.45/hr per GPU (spot instance).

Nvidia A100 logo A100 Pricing

There is a 97% difference between the highest and lowest listings for the A100. You can pay up to $5.04/hr, but the market floor is currently $0.13/hr per GPU (spot instance).

Heads up: We do our best to keep these specs & prices accurate. However, cloud costs may fluctuate based on region, usage, and other factors not listed here. These are estimates based on common setups and are for informational purposes only. Always verify current rates & exact specs with the provider before provisioning.

Alternative GPUs

Here's how these GPUs compare against alternatives:

View all GPUs

Our data for AMD MI300X was last updated on March 25, 2026, and for Nvidia A100 on Aug. 18, 2026.

Thunder Compute Logo
Thunder Compute
Our sponsor
NVIDIA H100 from $1.38/hr, A100 80GB from $0.78/hr, RTX A6000 from $0.27/hr
No commitments, billed per minute, SOC 2 and GDPR compliant
Hot swappable hardware, templates for ComfyUI and Ollama
One-click connection to VS Code or Cursor, simple CLI to connect without SSH
Try now