Nvidia A5000
Mid-range professional GPU for visualization and AI development.
- Arch
- Ampere
- Memory
- 24 GB GDDR6
- Bandwidth
- 768 GB/s
- Released
- Q2 2021
Price history
Weekly median price per GPU per hour
At a glance Updated 23 minutes ago
- Cheapest in stock
- $0.17 /GPU/hr
- on-demand · 2x · Vast.ai
- Median price (current)
- $0.75 /GPU/hr
- on-demand
- 90-day trend
- +19%
- median on-demand
- Coverage
- 13 providers
- 55 price points
Pricing & availability
How this list works
The two views
By provider shows one card per company, placed where its best offer ranked. By configuration lists every offer.
Order
What you can rent comes first: in stock, then waitlist, then not reported, then out of stock. Priced offers rank ahead of quote-only, and on-demand ahead of other billing types.
Within a group, five factors set the order:
- Location: datacenter proximity, blended with provider HQ.
- Price: hourly price, per GPU and in total.
- Billing type: reserved ahead of spot, spot ahead of quote-only.
- Specs: more VRAM, vCPUs and RAM.
- Provider diversity: a provider's repeat rows rank slightly lower, so one company can't take all the top spots.
Search
We match the provider, its country, GPU model, form factor, billing type, availability and instance name. Matching is partial and case-insensitive. Everyday words work too, so "interruptible" finds spot and "sold out" finds out of stock.
Transparency and funding
- Ads and sponsors: Paid placements sit at the top of the list and are always labeled as sponsored content. Sponsorship never influences the organic ranking itself.
- Affiliates: Affiliate links are marked. We may earn a commission if you click them, but commissions never affect the order.
- Prices: Shown in USD, converted at daily reference rates where a provider publishes in another currency. A month means 720 hours. How we estimate costs.
Runpod
In stockVast.ai
In stockRuncrate
In stockGPU.ai
In stockSesterce
In stockMassed Compute
Out of stockEmpirioLabs AI
Out of stockNo providers match .
Heads up: A provider's own page may quote a different figure, for example on tax, region or a promotion. A monthly-only plan shows a derived hourly rate. Verify before provisioning. More on how we price.
What can the A5000 run?
One A5000 has 24 GB of VRAM. In practice, that's enough memory for roughly 21B parameters at 4-bit or 6B at 16-bit, assuming a 32K context. Below are some open-weight LLMs, with the estimated memory and GPUs each one needs.
| Model | Memory (INT4 / FP4) | A5000s needed | Cost /hr | Cost /mo |
|---|---|---|---|---|
|
|
19 GB
|
1
|
$0.75
|
$540
|
|
|
24 GB
|
2
|
$1.50
|
$1,080
|
|
|
68 GB
|
4
|
$3.00
|
$2,160
|
|
|
178 GB
|
9
|
–
|
–
|
|
|
241 GB
|
12
|
–
|
–
|
|
|
306 GB
|
15
|
–
|
–
|
|
|
1,545 GB
|
72
|
–
|
–
|
Estimates based on the median on-demand rate. Memory is weights plus FP16/BF16 KV cache at 32K context per request. GPU counts assume 90% of advertised VRAM is usable. No guarantee of runtime support, usable performance, or that a matching quantized build exists. How we estimate costs.
Technical Specifications
Nvidia A5000 · Per GPU
| Compute · dense | |
|---|---|
| FP16 / BF16 | 111.1 TFLOPS 222.2 with sparsity |
| FP32 | 27.8 TFLOPS |
| Precision support | FP16BF16TF32FP32INT4INT8 |
| Memory | |
|---|---|
| Capacity | 24 GB GDDR6 |
| Bandwidth | 768 GB/s |
| Bus width | 384-bit |
| ECC | Yes |
| Silicon | |
|---|---|
| Architecture | Ampere |
| Process | Samsung 8N |
| Transistors | 28.3 billion |
| Shader cores | 8,192 CUDA cores |
| Matrix cores | 256 Tensor cores |
| Compute units | 64 SMs |
| Fabric and host | |
|---|---|
| GPU interconnect | NVLink 112 GB/s |
| Host interface | PCIe 4.0 x16 |
| Power | |
|---|---|
| Board power | 230 W |
| Cooling | Active |
Source: official Nvidia A5000 datasheet.
Frequently Asked Questions
How much does the A5000 cost per hour?
-
As of September 13, 2026, the median on-demand price is $0.75 per GPU per hour across 8 providers with a priced on-demand config.
Billing type Configs Median /GPU/hr Cheapest On-demand
30
$0.75
$0.17 (in stock, Vast.ai)
Reserved
19
$0.32
$0.18 (3 mo, in stock, Vast.ai)
Spot
6
$0.09
No median for spot: we only show this when at least 3 providers list the GPU on that billing type.
Who has the cheapest A5000?
How much does the A5000 cost per month?
-
At 720 hours per month, one A5000 costs an estimated $540 at the median on-demand price. Cheapest verified in stock: $122 per month on-demand, $130 reserved (3 mo), $79 spot.
Where can I rent an A5000?
-
GetDeploying currently tracks A5000 configs from 13 providers. The cheapest verified in-stock on-demand configs come from Vast.ai, GPU.ai, Salad and Runpod. See the full price comparison above for every provider and config.
Are A5000 prices going up or down?
-
As of September 13, 2026, the median on-demand price has risen about 19% over the past 90 days to $0.75 per GPU per hour, and about 216% over the past 12 months.
How many A5000 GPUs do I need?
-
One A5000 runs models up to roughly 21B parameters at 4-bit quantization or 6B at 16-bit, assuming a 32K context. Larger models run across multiple GPUs: the model table above shows the estimated memory and GPU count for popular open-weight LLMs.
Why choose the A5000?
-
24GB GDDR6 with NVLink (112 GB/s). Professional workstation GPU with ECC memory. Good for mixed AI development and visualization.
Alternatives to Nvidia A5000
Last updated