AMD MI300X
vs
Nvidia RTX 4060
A data center GPU against a consumer card, one CDNA 3 and one Ada Lovelace: 192 GB HBM3 against 8 GB GDDR6, 19x the memory bandwidth on the MI300X, and Infinity Fabric 896 GB/s on the MI300X where the RTX 4060 is PCIe only.
At a glance
Memory
- MI300X
- 192 GB
- RTX 4060
- 8 GB
24x more on MI300X
Memory bandwidth
- MI300X
- 5,300 GB/s
- RTX 4060
- 272 GB/s
19x higher on MI300X
Cheapest on-demand
- MI300X
- $2.39 /GPU/hr
- RTX 4060
- $0.08 /GPU/hr
30x more expensive on MI300X
Price comparison
Median price per GPU per hour by billing type, with the cheapest listing under it.
| Billing | MI300X | RTX 4060 | Difference |
|---|---|---|---|
| On-demand | $2.91 /GPU/hr from $2.39 | -- /GPU/hr from $0.08 | |
| Reserved | $3.39 /GPU/hr from $1.61 (12 mo) | -- /GPU/hr from $0.21 (24 mo) | |
| Spot | -- /GPU/hr from $1.60 | -- /GPU/hr from $0.05 |
Heads up: A provider's own page may quote a different figure, for example on tax, region or a promotion. A monthly-only plan shows a derived hourly rate. Medians are across providers, one vote each, so a large catalog does not outweigh a small one. No median for spot on the MI300X and on-demand, reserved and spot on the RTX 4060: we only show one when at least 3 providers list the GPU on that billing type. Verify before provisioning. More on how we price.
Price history
MI300X vs RTX 4060 price history
Weekly median on-demand price per GPU per hour
Specs comparison
| Spec | MI300X | RTX 4060 | Difference |
|---|---|---|---|
| Memory | |||
| Capacity | 192 GB HBM3 | 8 GB GDDR6 | 24x more on MI300X |
| Bandwidth | 5,300 GB/s | 272 GB/s | 19x higher on MI300X |
| Bus width | 8,192-bit | 128-bit | 64x wider on MI300X |
| Compute · dense | |||
| FP8 | 2,614.9 TFLOPS | 60.5 TFLOPS | 43x higher on MI300X |
| FP16 / BF16 | 1,307.4 TFLOPS | 30.2 TFLOPS | 43x higher on MI300X |
| INT8 | 2,614.9 TOPS | 120.9 TOPS | 22x higher on MI300X |
| FP32 | 163.4 TFLOPS | 15.1 TFLOPS | 11x higher on MI300X |
| FP64 | 81.7 TFLOPS | Not supported | MI300X only |
| Platform | |||
| Interconnect | Infinity Fabric 896 GB/s | PCIe only | Infinity Fabric on MI300X only |
| Board power | 750 W | 115 W | 6.5x higher on MI300X |
| Released | Q4 2023 | Q2 2023 | |
| Precision | |||
| Supported formats | FP8FP16BF16TF32FP32FP64INT8 | FP8FP16BF16TF32FP32INT4INT8 | |
Compute: Vendor peak figures, dense and per GPU. Not measured throughput.
Source: MI300X datasheet and RTX 4060 datasheet.
Where to rent them
Providers listing these GPUs, those with both first, so you can switch without moving clouds.
| Provider | MI300X /GPU/hr | RTX 4060 /GPU/hr |
|---|---|---|
Runpod
|
On-Demand $2.39 | -- |
DigitalOcean
|
On-Demand $2.59 | -- |
Cyfuture AI
|
On-Demand $2.78 | -- |
Hot Aisle
|
On-Demand $2.99 | -- |
Oracle Cloud
|
On-Demand $6.00 | -- |
Azure
|
On-Demand $7.86 | -- |
Cirrascale
|
Reserved (12mo) $3.12 | -- |
Crusoe
|
Reservation on request | -- |
Salad
|
-- | On-Demand $0.08 |
Theta EdgeCloud
|
-- | On-Demand $0.14 |
Database Mart
|
-- | Reserved (24mo) $0.21 |
10 providers list the MI300X and 3 the RTX 4060. Every listing is on the MI300X page and the RTX 4060 page.
Similar GPUs
Other comparisons in the same class.
Our data for AMD MI300X was last updated on Sept. 7, 2026, and for Nvidia RTX 4060 on Sept. 7, 2026.