Overview
AMD MI300X
|
Nvidia L40
|
|
|---|---|---|
| Summary | AMD's flagship data center GPU for large-model inference. | Data center GPU for combined AI inference and visualization. |
| Architecture | CDNA 3 | Ada Lovelace |
| Memory | 192GB HBM3 | 48GB GDDR6 |
| Memory Bandwidth | 5,300 GB/s | 864 GB/s |
| Performance | 1,307 TFLOPS (FP16) | 181 TFLOPS (FP16) |
| Release Date | Q4 2023 | Q4 2022 |
| Performance Segment | High Performance | High Performance |
| Datasheet | Link | Link |
Price comparison
MI300X Pricing
Listings for the MI300X reach $7.86/hr, often reflecting a premium for high availability. However, you might be able to find available instances from as low as $0.95/hr per GPU (spot instance).
How we sort results
Default ranking
Our algorithm weighs five factors to find the most relevant matches for you:
- Price: We blend total hourly price with price-per-GPU to balance affordability and value.
- Specs: We favor offers with higher CPU, RAM, and GPU Memory.
- Billing: We favor on-demand billing for simplicity and flexibility over spot instances, reservations, and custom quotes.
- Location: We blend both datacenter proximity and provider HQ location. Datacenter location matters for latency, while HQ location matters for compliance and support.
- Provider diversity: Each time a provider appears in the list, their subsequent offerings are ranked a little lower, so one provider's offerings don't crowd out the top positions.
Sorting and filtering
Click "View all offerings" to access the full list with sortable columns and filters for billing type, GPU count, vCPUs, and RAM.
Transparency and funding
Ads and sponsors: Any paid placements are fixed at the top and clearly labeled as sponsored content.
Affiliates: Any affiliate links will be indicated to you as well. We may earn a commission if you click them, but this never influences the ranking order.
| Provider | GPUs | Billing | Total/h | |
|---|---|---|---|---|
DigitalOcean
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $1.99 | View |
Hot Aisle
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $1.99 | View |
|
Hot Aisle
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $1.99 | View |
Crusoe
|
8x | On-Demand Pay-as-you-go pricing. No term commitments. | $27.60 | View |
|
DigitalOcean
|
8x | On-Demand Pay-as-you-go pricing. No term commitments. | $15.92 | View |
|
Hot Aisle
|
2x | On-Demand Pay-as-you-go pricing. No term commitments. | $3.98 | View |
|
Hot Aisle
|
4x | On-Demand Pay-as-you-go pricing. No term commitments. | $7.96 | View |
Vultr
|
8x | Reserved (24mo) Reserved capacity with a 24-month minimum commitment. | $14.80 | View |
Azure
|
8x | Spot Variable spot pricing with potential interruptions. | $11.62 | View |
|
Crusoe
|
8x | Spot Variable spot pricing with potential interruptions. | $7.60 | View |
Cirrascale
|
8x | Reserved (12mo) 12-month contract: $17,999/month | $24.99 | View |
Oracle Cloud
|
8x | On-Demand Pay-as-you-go pricing. No term commitments. | $48.00 | View |
|
DigitalOcean
|
8x | Reserved (12mo) Reserved capacity with a 1-year minimum commitment. | $15.04 | View |
|
Cirrascale
|
8x | Reserved (6mo) 6-month contract: $20,249/month | $28.12 | View |
|
Azure
|
8x | On-Demand Pay-as-you-go pricing. No term commitments. | $62.85 | View |
| No offerings matching your filters. | ||||
L40 Pricing
Listings for the L40 reach $1.64/hr, often reflecting a premium for high availability. However, you might be able to find available instances from as low as $0.27/hr per GPU (spot instance).
How we sort results
Default ranking
Our algorithm weighs five factors to find the most relevant matches for you:
- Price: We blend total hourly price with price-per-GPU to balance affordability and value.
- Specs: We favor offers with higher CPU, RAM, and GPU Memory.
- Billing: We favor on-demand billing for simplicity and flexibility over spot instances, reservations, and custom quotes.
- Location: We blend both datacenter proximity and provider HQ location. Datacenter location matters for latency, while HQ location matters for compliance and support.
- Provider diversity: Each time a provider appears in the list, their subsequent offerings are ranked a little lower, so one provider's offerings don't crowd out the top positions.
Sorting and filtering
Click "View all offerings" to access the full list with sortable columns and filters for billing type, GPU count, vCPUs, and RAM.
Transparency and funding
Ads and sponsors: Any paid placements are fixed at the top and clearly labeled as sponsored content.
Affiliates: Any affiliate links will be indicated to you as well. We may earn a commission if you click them, but this never influences the ranking order.
| Provider | GPUs | Billing | Total/h | |
|---|---|---|---|---|
Thunder Compute
Our sponsor
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $0.89 | View |
CoreWeave
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $1.25 | View |
Together
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $1.49 | View |
Sesterce
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $0.97 | View |
Hyperstack
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $1.00 | View |
Oblivus
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $1.05 | View |
|
Thunder Compute
|
2x | On-Demand Pay-as-you-go pricing. No term commitments. | $1.78 | View |
|
Sesterce
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $1.10 | View |
Vast.ai
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $0.47 | View |
|
Thunder Compute
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $1.39 | View |
Massed Compute
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $0.86 | View |
Runcrate
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $0.97 | View |
|
Sesterce
|
2x | On-Demand Pay-as-you-go pricing. No term commitments. | $2.18 | View |
TensorDock
|
1x | On-Demand Starting price, marketplace rates vary | $1.06 | View |
|
Vast.ai
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $0.46 | View |
| No offerings matching your filters. | ||||
Heads up: We do our best to keep these specs & prices accurate. However, cloud costs may fluctuate based on region, usage, and other factors not listed here. These are estimates based on common setups and are for informational purposes only. Always verify current rates & exact specs with the provider before provisioning.
Alternative GPUs
Here's how these GPUs compare against alternatives:
AMD MI300X
vs
Nvidia H100
AMD MI300X
vs
AMD MI325X
Nvidia L40
vs
Nvidia L40S
Nvidia L40
vs
Nvidia A100
Our data for AMD MI300X was last updated on March 25, 2026, and for Nvidia L40 on March 25, 2026.