Nvidia A100

Nvidia A100

Previous-gen data center workhorse for AI training and inference.

Compare vs other GPUs →
Aggregating historical prices...

Weekly median price per GPU per hour. Nvidia A100 price history (JSON).

At a glance

Hardware

Architecture
Ampere
Memory per GPU
80 GB HBM2e (PCIe) PCIe
Memory bandwidth
1,935 GB/s (PCIe) PCIe
Release date
Q2 2020

Market Updated 2 minutes ago

Cheapest in stock
$0.53 / GPU / hr
on-demand · 4x PCIe · Vast.ai
Median price
$1.73 / GPU / hr
on-demand
90-day trend
Flat
median on-demand
Coverage
42 providers
177 of 438 configs in stock

A100 Pricing and Availability

42 providers

How this list works

The two views

By provider shows one card per company, placed where its best offer ranked. By configuration lists every offer.

Order

What you can rent comes first: in stock, then waitlist, then not reported, then out of stock. Priced offers rank ahead of quote-only, and on-demand ahead of other billing types.

Within a group, five factors set the order:

  1. Location: datacenter proximity, blended with provider HQ.
  2. Price: hourly price, per GPU and in total.
  3. Billing type: reserved ahead of spot, spot ahead of quote-only.
  4. Specs: more VRAM, vCPUs and RAM.
  5. Provider diversity: a provider's repeat rows rank slightly lower, so one company can't take all the top spots.

Search

We match the provider, its country, GPU model, form factor, billing type, availability and instance name. Matching is partial and case-insensitive. Everyday words work too, so "interruptible" finds spot and "sold out" finds out of stock.

Transparency and funding

  • Ads and sponsors: Paid placements sit at the top of the list and are always labeled as sponsored content. Sponsorship never influences the organic ranking itself.
  • Affiliates: Affiliate links are marked. We may earn a commission if you click them, but commissions never affect the order.
  • Prices: Shown in USD, converted at daily reference rates where a provider publishes in another currency. A month means 720 hours. How we estimate costs.
Packet·ai logo

Packet·ai

Our sponsor

United States of America flag USA 1 config 1x

On-Demand from $1.43
From $1.43 / GPU / hr On-Demand Visit website
Vast.ai logo

Vast.ai

In stock

United States of America flag USA 55 configs 1x-4x

On-Demand from $0.53 Reserved from $0.49 Spot from $0.13
From $0.53 / GPU / hr On-Demand PCIe Visit website
Massed Compute logo

Massed Compute

In stock

United States of America flag USA 9 configs 1x-8x

On-Demand from $1.35 Spot from $1.24
From $1.35 / GPU / hr On-Demand Visit website
Runpod logo

Runpod

In stock

United States of America flag USA 11 configs 1x-8x

On-Demand from $1.00 Reserved on request
From $1.00 / GPU / hr On-Demand SXM Visit website
Geodd logo

Geodd

In stock

United States of America flag USA 4 configs 1x-8x

On-Demand from $1.49
From $1.49 / GPU / hr On-Demand SXM Visit website
Runcrate logo

Runcrate

In stock

United States of America flag USA 2 configs 1x

On-Demand from $1.49
From $1.49 / GPU / hr On-Demand SXM Visit website
Theta EdgeCloud logo

Theta EdgeCloud

In stock

United States of America flag USA 4 configs 1x-8x

On-Demand from $1.99
From $1.99 / GPU / hr On-Demand Visit website
Lambda Labs logo

Lambda Labs

In stock

United States of America flag USA 6 configs 1x-8x

On-Demand from $1.99
From $1.99 / GPU / hr On-Demand SXM Visit website
Thunder Compute logo

Thunder Compute

In stock

United States of America flag USA 4 configs 1x-8x

On-Demand from $1.09
From $1.09 / GPU / hr On-Demand Visit website
Oblivus logo

Oblivus

In stock

United States of America flag USA 39 configs 1x-8x

On-Demand from $1.47 Reserved from $0.95 Spot from $1.51
From $1.47 / GPU / hr On-Demand PCIe Visit website
Microsoft Azure logo

Azure

In stock

United States of America flag USA 20 configs 1x-8x

On-Demand from $3.40 Reserved from $1.70 Spot from $0.68
From $3.40 / GPU / hr On-Demand Visit website
Google Cloud logo

Google Cloud

In stock

United States of America flag USA 36 configs 1x-16x

On-Demand from $3.48 Reserved from $1.31 Spot from $0.37
From $3.48 / GPU / hr On-Demand Visit website
Sesterce logo

Sesterce

In stock

France flag France 11 configs 1x-8x

On-Demand from $1.49
From $1.49 / GPU / hr On-Demand Visit website
Koyeb logo

Koyeb

In stock

France flag France 8 configs 1x-8x

On-Demand from $1.60
From $1.60 / GPU / hr On-Demand Visit website
Lyceum logo

Lyceum

In stock

Germany flag Germany 9 configs 1x-8x

On-Demand from $1.59 Reserved on request Spot from $0.80
From $1.59 / GPU / hr On-Demand Visit website
Amazon Web Services logo

AWS

In stock

United States of America flag USA 6 configs 8x

On-Demand from $2.74 Reserved from $1.17
From $2.74 / GPU / hr On-Demand Visit website
GPU.ai logo

GPU.ai

In stock

United Arab Emirates flag UAE 8 configs 1x-8x

On-Demand from $0.71
From $0.71 / GPU / hr On-Demand Visit website
Spheron logo

Spheron

In stock

Singapore flag Singapore 5 configs 1x-8x

On-Demand from $1.43
From $1.43 / GPU / hr On-Demand PCIe Visit website
GPUaaS logo

GPUaaS

In stock

United States of America flag USA 1 config 4x

Custom on request
Pricing On request Custom Visit website
Cerebrium logo

United States of America flag USA 8 configs 1x-8x

On-Demand from $2.00
From $2.00 / GPU / hr On-Demand Visit website
Beam logo

United States of America flag USA 1 config 1x

On-Demand from $1.30
From $1.30 / GPU / hr On-Demand SXM Visit website
TensorDock logo

United States of America flag USA 2 configs 1x

On-Demand from $1.61
From $1.61 / GPU / hr On-Demand PCIe Visit website
Paperspace logo

United States of America flag USA 4 configs 1x-8x

On-Demand from $3.09
From $3.09 / GPU / hr On-Demand Visit website
Hyperstack logo

United Kingdom flag UK 6 configs 1x

On-Demand from $1.35 Reserved from $0.95 Spot from $1.08
From $1.35 / GPU / hr On-Demand Visit website
Gcore logo

Luxembourg flag Luxembourg 5 configs 1x-8x

On-Demand from $1.46
From $1.46 / GPU / hr On-Demand SXM Visit website
Civo logo

United Kingdom flag UK 40 configs 1x-8x

On-Demand from $1.09 Reserved from $0.69
From $1.09 / GPU / hr On-Demand Visit website
Replicate logo

United States of America flag USA 4 configs 1x-8x

On-Demand from $5.04
From $5.04 / GPU / hr On-Demand Visit website
OVHcloud logo

OVH

France flag France 3 configs 1x-4x

On-Demand from $3.07
From $3.07 / GPU / hr On-Demand Visit website
CoreWeave logo

United States of America flag USA 2 configs 8x

On-Demand from $2.70 Spot from $1.21
From $2.70 / GPU / hr On-Demand SXM Visit website
Leafcloud logo

Netherlands flag Netherlands 4 configs 1x-8x

On-Demand from $1.85
From $1.85 / GPU / hr On-Demand PCIe Visit website
Oracle Cloud logo

United States of America flag USA 2 configs 8x

On-Demand from $3.05
From $3.05 / GPU / hr On-Demand Visit website
Elastx logo

Sweden flag Sweden 2 configs 1x-2x

On-Demand from $3.81
From $3.81 / GPU / hr On-Demand Visit website
Cyfuture AI logo

India flag India 16 configs 1x-8x

On-Demand from $2.02 Reserved from $1.85
From $2.02 / GPU / hr On-Demand Visit website
Database Mart logo

United States of America flag USA 12 configs 1x-4x

Reserved from $0.50
From $0.50 / GPU / hr Reserved (24mo) Visit website
Cirrascale logo

United States of America flag USA 12 configs 4x-8x

Reserved from $2.33
From $2.33 / GPU / hr Reserved (12mo) Visit website
AceCloud logo

India flag India 9 configs 1x-4x

Reserved from $1.65
From $1.65 / GPU / hr Reserved (12mo) Visit website
Crusoe logo

United States of America flag USA 7 configs 1x-8x

On-Demand from $2.00 (sold out) Reserved on request Spot on request
Pricing On request Reservation SXM Visit website
Green AI Cloud logo

Sweden flag Sweden 1 config 8x

Custom on request
Pricing On request Custom SXM Visit website
Novita logo

Novita

Out of stock

United States of America flag USA 8 configs 1x-8x

On-Demand from $1.60 Spot from $0.80
From $1.60 / GPU / hr On-Demand SXM Visit website
Vultr logo

Vultr

Out of stock

United States of America flag USA 3 configs 4x-8x

On-Demand from $2.40 Spot from $1.49
From $2.40 / GPU / hr On-Demand Visit website
Verda logo

Verda

Out of stock

Finland flag Finland 42 configs 1x-8x

On-Demand from $1.29 Reserved from $0.97 Spot from $0.65
From $1.29 / GPU / hr On-Demand SXM Visit website
Cloudzy logo

Cloudzy

Out of stock

United Arab Emirates flag UAE 6 configs 1x-4x

On-Demand from $1.64 Reserved from $1.53
From $1.64 / GPU / hr On-Demand Visit website

Heads up: A provider's own page may quote a different figure, for example on tax, region or a promotion. A monthly-only plan shows a derived hourly rate. Verify before provisioning. More on how we price.

What size AI models can the A100 run?

One A100 has 80 GB of VRAM on the PCIe variant. In practice, that's enough memory for roughly 113B parameters at 4-bit or 31B at 16-bit, assuming a 32K context. Below are some open-weight LLMs, with the estimated memory and GPUs each one needs.

Model Parameters 4-bitINT4 / FP4 8-bitFP8 / INT8 16-bitFP16 / BF16
Alibaba Cloud logo Qwen3.8-27B
27B
1 GPU 19 GB VRAM · $1,246/mo
1 GPU 31 GB VRAM · $1,246/mo
1 GPU 58 GB VRAM · $1,246/mo
Google Cloud logo Gemma 4 31B
30.7B
1 GPU 24 GB VRAM · $1,246/mo
1 GPU 38 GB VRAM · $1,246/mo
1 GPU 69 GB VRAM · $1,246/mo
OpenAI logo GPT-OSS-120B
117B 5.1B active
1 GPU 68 GB VRAM · $1,246/mo
2 GPUs 120 GB VRAM · $2,491/mo
4 GPUs 237 GB VRAM · $4,982/mo
DeepSeek logo DeepSeek V4 Flash
284B 13B active
4 GPUs 161 GB VRAM · $4,982/mo
8 GPUs 289 GB VRAM · $9,965/mo
8 GPUs 573 GB VRAM · $9,965/mo
Z.AI logo GLM-5.3-Flash
320B 18B active
4 GPUs 178 GB VRAM · $4,982/mo
8 GPUs 322 GB VRAM · $9,965/mo
9 GPUs 642 GB VRAM
MiniMax logo MiniMax-M3
428B 23B active
4 GPUs 241 GB VRAM · $4,982/mo
8 GPUs 434 GB VRAM · $9,965/mo
12 GPUs 862 GB VRAM
Moonshot AI logo Kimi K3
2.8T 104B active
22 GPUs 1,545 GB VRAM
39 GPUs 2,805 GB VRAM
78 GPUs 5,605 GB VRAM

Estimates based on the median on-demand rate. Memory is weights plus FP16/BF16 KV cache at 32K context per request. GPU counts assume 90% of advertised VRAM is usable. No guarantee of runtime support, usable performance, or that a matching quantized build exists. How we estimate costs.

Technical Specifications

Nvidia A100 · Per GPU · PCIe

Compute · dense
FP16 / BF16 312 TFLOPS 624 with sparsity
INT8 624 TOPS 1,248 with sparsity
FP32 19.5 TFLOPS
FP64 9.7 TFLOPS
Precision support FP16BF16TF32FP32FP64INT4INT8
Memory
Capacity 80 GB HBM2e
Bandwidth 1,935 GB/s
Bus width 5,120-bit
ECC Yes
Silicon
Architecture Ampere
Process TSMC N7
Transistors 54.2 billion
Shader cores 6,912 CUDA cores
Matrix cores 432 Tensor cores
Compute units 108 SMs
Fabric and host
GPU interconnect NVLink 600 GB/s
Host interface PCIe 4.0 x16
Power
Board power 300 W
Cooling Passive
Platform
Partitioning MIG, up to 7 instances

Source: official Nvidia A100 datasheet.

Frequently Asked Questions

How much does the A100 cost per hour?

As of September 3, 2026, the median on-demand price is $1.73 per GPU per hour across 32 providers with a priced on-demand config.

Billing type Configs Median / GPU / hr Cheapest in stock
On-demand 183 $1.73 $0.53 (Vast.ai)
Reserved 203 $1.75 $0.49 (3 mo, Vast.ai)
Spot 50 $0.73 $0.13 (Vast.ai)
Custom contract 2 On request

Custom-contract pricing is negotiated per deal and usually not published.

Who has the cheapest A100?

As of September 3, 2026, the cheapest verified in-stock on-demand A100 tracked by GetDeploying is $0.53 per GPU per hour from Vast.ai. Cheapest verified in stock on other billing types: reserved $0.49 (3 mo) and spot $0.13, also from Vast.ai.

How much does the A100 cost per month?

As of September 3, 2026, at 720 hours per month, one A100 costs an estimated $1,246 at the median on-demand price. Cheapest verified in stock: $382 per month on-demand, $353 reserved (3 mo), $94 spot.

Where can I rent an A100?

GetDeploying currently tracks A100 configs from 42 providers. The cheapest verified in-stock on-demand configs come from Vast.ai, GPU.ai, Runpod and Thunder Compute. See the full price comparison above for every provider and config.

Are A100 prices going up or down?

As of September 3, 2026, the median on-demand price has been flat over the past 90 days, at about $1.73 per GPU per hour, though it is about 8% above where it was a year ago.

How many A100 GPUs do I need?

One A100 runs models up to roughly 113B parameters at 4-bit quantization or 31B at 16-bit, assuming a 32K context. Larger models run across multiple GPUs: the model table above shows the estimated memory and GPU count for popular open-weight LLMs.

Why choose the A100?

80GB or 40GB HBM2e with 600 GB/s NVLink. The previous-generation workhorse for AI training. Mature software ecosystem and wide cloud availability make it a reliable, well-priced choice.

When is the A100 not a good fit?

Lacks FP8 support found in Hopper and Blackwell GPUs. For new large-scale training projects, the H100 offers significantly better performance per dollar. Consider the L40S for pure inference.

What's the difference between the A100 PCIe and SXM?

The A100 ships in 4 versions with different memory, bandwidth or interconnect. The figures at the top of this page are for the A100 PCIe.

Variant Memory Memory bandwidth Interconnect
A100 PCIe 80 GB 1,935 GB/s NVLink 600 GB/s
A100 SXM 80 GB 2,039 GB/s NVLink 600 GB/s
A100 SXM 40 GB 1,555 GB/s NVLink 600 GB/s
A100 PCIe 40 GB 1,555 GB/s NVLink 600 GB/s

Alternatives to Nvidia A100

Last updated