80GB or 40GB HBM2e with 600 GB/s NVLink. The previous-generation workhorse for AI training. Mature software ecosystem and wide cloud availability make it a reliable, well-priced choice.

When is the A100 not a good fit?

Lacks FP8 support found in Hopper and Blackwell GPUs. For new large-scale training projects, the H100 offers significantly better performance per dollar. Consider the L40S for pure inference.

Are A100 prices going up or down?

On-demand pricing has decreased by about 11% since June 2025, dropping from $2.27 to $2.02/hr per GPU.

What size AI models can the A100 run?

With 80GB of VRAM, the A100 is well suited to 30B-class models in FP16, and 70B-class models in 4-bit or 8-bit quantized form.

How much VRAM does the A100 have?

The A100 has 80GB of VRAM. Multi-GPU setups increase total memory, but that memory is not automatically pooled across GPUs.

What is the A100's memory bandwidth?

The A100 has 1,935 GB/s of memory bandwidth. Higher bandwidth helps with faster data transfer between GPU memory and compute cores.

What data types does the A100 support?

The A100 supports 7 precision formats. Training: BF16, FP16, TF32, FP32. Inference: INT4, INT8. Scientific: FP64.

Does the A100 support NVLink?

Yes. The A100 supports NVLink with 600 GB/s of bidirectional bandwidth. This helps accelerate multi-GPU communication.

How much does the A100 cost per hour?

A100 pricing currently ranges from $0.31/hr to $5.04/hr per GPU, depending on the provider, instance type, and billing model.

How much does the A100 cost per month?

At 720 hours per month, one A100 can cost between $224.78 to $3,628.80 per month, depending on the provider. Reserved and spot pricing can lower that further.

Which cloud providers offer the A100?

The A100 is available from 39 cloud providers, including Civo, Runpod, Sesterce. Pricing and availability vary by region and billing model.

Can I rent the A100 in the cloud?

Yes. We currently track 351 A100 listings across 39 cloud providers: Billing type Listings Avg $/GPU/hr On-demand 180 $1.95/hr Reserved 117 $1.68/hr Spot 52 $0.76/hr Custom contract 2 $0.99/hr

Nvidia A100

Previous-gen data center workhorse for AI training and inference.

Compare vs other GPUs →

Aggregating historical prices...

Key Specifications

Architecture

Ampere

Memory

40GB / 80GB HBM2e

Memory Bandwidth

1,935 GB/s

Release date

Q2 2020

Compare Cloud Provider Prices

There is a 93% difference between the highest and lowest listings for the A100. You can pay up to $5.04/hr, but the market floor is currently $0.31/hr per GPU (spot instance).

Billing

Max price/hr

Min GPUs

Min vCPUs

Min RAM (GB)

of shown

Default ranking

Our algorithm weighs five factors to find the most relevant matches for you:

Price: We blend total hourly price with price-per-GPU to balance affordability and value.
Specs: We favor offers with higher CPU, RAM, and GPU Memory.
Billing: We favor on-demand billing for simplicity and flexibility over spot instances, reservations, and custom quotes.
Location: We blend both datacenter proximity and provider HQ location. Datacenter location matters for latency, while HQ location matters for compliance and support.
Provider diversity: Each time a provider appears in the list, their subsequent offerings are ranked a little lower, so one provider's offerings don't crowd out the top positions.

Sorting and filtering

Click any column header to sort by that column. Use the filters above the table to narrow results by billing type, GPU count, vCPUs, or RAM. Custom sorting resets the default relevance ranking.

Transparency and funding

Ads and sponsors: Any paid placements are fixed at the top and clearly labeled as sponsored content.

Affiliates: Any affiliate links will be indicated to you as well. We may earn a commission if you click them, but this never influences the ranking order.

Provider	GPUs	Total VRAM	vCPUs	RAM	Billing	$/GPU/h	Total/h	Availability
Thunder Compute Our sponsor	1x A100 1x A100 80GB (Prototyping)	80GB	4	32GB	On-Demand Pay-as-you-go pricing. No term commitments.	$0.78	$0.78	Available	View
Runpod	1x A100 PCIe 1x A100 80GB PCIe (community-cloud)	80GB	10	120GB	On-Demand Pay-as-you-go pricing. No term commitments.	$1.19	$1.19	Available	View
Packet·ai	1x A100 1x A100 80GB	80GB	--	--	On-Demand Pay-as-you-go pricing. No term commitments.	$1.43	$1.43	Unknown	View
Novita	1x A100 SXM 1x A100 80GB SXM	80GB	--	--	On-Demand Pay-as-you-go pricing. No term commitments.	$1.60	$1.60	Unknown	View
Crusoe	1x A100 1x A100 80GB (a100-80gb.1x)	80GB	12	120GB	On-Demand Pay-as-you-go pricing. No term commitments.	$1.65	$1.65	Unknown	View
Theta EdgeCloud	1x A100 1x A100 80GB (vm_ga1)	80GB	10	80GB	On-Demand Pay-as-you-go pricing. No term commitments.	$1.99	$1.99	Available	View
Vultr	1x A100 1x A100 80GB	80GB	12	120GB	On-Demand Pay-as-you-go pricing. No term commitments.	$2.40	$2.40	Unknown	View
Together	1x A100 1x A100 80GB	80GB	--	--	On-Demand Pay-as-you-go pricing. No term commitments.	$2.40	$2.40	Unknown	View
Lambda Labs	1x A100 PCIe 1x A100 40GB PCIe	40GB	30	225GB	On-Demand Pay-as-you-go pricing. No term commitments.	$1.99	$1.99	Unknown	View
CoreWeave	1x A100 1x A100 80GB	80GB	--	--	On-Demand Pay-as-you-go pricing. No term commitments.	$2.70	$2.70	Available	View
Fly.io	1x A100 1x A100 40GB	40GB	--	--	On-Demand Pay-as-you-go pricing. No term commitments.	$2.50	$2.50	Unknown	View
Paperspace	1x A100 1x A100 80GB	80GB	8	90GB	On-Demand Pay-as-you-go pricing. No term commitments.	$3.28	$3.28	Unknown	View
Runpod	1x A100 SXM 1x A100 80GB SXM (community-cloud)	80GB	10	120GB	On-Demand Pay-as-you-go pricing. No term commitments.	$1.39	$1.39	Available	View
Azure	1x A100 1x A100 80GB (NCads A100 v4 Linux)	80GB	24	220GB	On-Demand Pay-as-you-go pricing. No term commitments.	$3.67	$3.67	Available	View
Hyperstack	1x A100 1x A100 80GB	80GB	28	120GB	On-Demand Pay-as-you-go pricing. No term commitments.	$1.35	$1.35	Unknown	View
CUDO	1x A100 1x A100 80GB	80GB	16	--	On-Demand Pay-as-you-go pricing. No term commitments.	$1.35	$1.35	Unknown	View
Google Cloud	1x A100 1x A100 80GB (a2-ultragpu-1g)	80GB	12	170GB	On-Demand Pay-as-you-go pricing. No term commitments.	$4.03	$4.03	Available	View
Sesterce	1x A100 1x A100 80GB	80GB	28	120GB	On-Demand Pay-as-you-go pricing. No term commitments.	$1.49	$1.49	Available	View
Crusoe	1x A100 1x A100 40GB (a100.1x)	40GB	12	120GB	On-Demand Pay-as-you-go pricing. No term commitments.	$1.45	$1.45	Unknown	View
Koyeb	1x A100 1x A100 80GB	80GB	15	180GB	On-Demand Pay-as-you-go pricing. No term commitments.	$1.60	$1.60	Available	View
No offerings matching your filters.

Heads up: We do our best to keep these prices accurate. However, cloud costs may fluctuate based on region, usage, and other factors not listed here. These are estimates based on common setups and are for informational purposes only. Always verify current rates with the provider before provisioning.

Frequently Asked Questions

Why choose the A100?: 80GB or 40GB HBM2e with 600 GB/s NVLink. The previous-generation workhorse for AI training. Mature software ecosystem and wide cloud availability make it a reliable, well-priced choice.
When is the A100 not a good fit?: Lacks FP8 support found in Hopper and Blackwell GPUs. For new large-scale training projects, the H100 offers significantly better performance per dollar. Consider the L40S for pure inference.
Are A100 prices going up or down?: On-demand pricing has decreased by about 11% since June 2025, dropping from $2.27 to $2.02/hr per GPU.
What size AI models can the A100 run?: With 80GB of VRAM, the A100 is well suited to 30B-class models in FP16, and 70B-class models in 4-bit or 8-bit quantized form.
How much VRAM does the A100 have?: The A100 has 80GB of VRAM. Multi-GPU setups increase total memory, but that memory is not automatically pooled across GPUs.
What is the A100's memory bandwidth?: The A100 has 1,935 GB/s of memory bandwidth. Higher bandwidth helps with faster data transfer between GPU memory and compute cores.
What data types does the A100 support?: The A100 supports 7 precision formats. Training: BF16, FP16, TF32, FP32. Inference: INT4, INT8. Scientific: FP64.
Does the A100 support NVLink?: Yes. The A100 supports NVLink with 600 GB/s of bidirectional bandwidth. This helps accelerate multi-GPU communication.
How much does the A100 cost per hour?: A100 pricing currently ranges from $0.31/hr to $5.04/hr per GPU, depending on the provider, instance type, and billing model.
How much does the A100 cost per month?: At 720 hours per month, one A100 can cost between $224.78 to $3,628.80 per month, depending on the provider. Reserved and spot pricing can lower that further.
Which cloud providers offer the A100?: The A100 is available from 39 cloud providers, including Civo, Runpod, Sesterce. Pricing and availability vary by region and billing model.
Can I rent the A100 in the cloud?: Yes. We currently track 351 A100 listings across 39 cloud providers:

Billing type Listings Avg $/GPU/hr

On-demand 180 $1.95/hr

Reserved 117 $1.68/hr

Spot 52 $0.76/hr

Custom contract 2 $0.99/hr

Billing type	Listings	Avg $/GPU/hr
On-demand	180	$1.95/hr
Reserved	117	$1.68/hr
Spot	52	$0.76/hr
Custom contract	2	$0.99/hr

Technical Specifications

	A100 40GB PCIe	A100 80GB PCIe	A100 40GB SXM	A100 80GB SXM
FP64	9.7 TFLOPS	9.7 TFLOPS	9.7 TFLOPS	9.7 TFLOPS
FP64 Tensor Core	19.5 TFLOPS	19.5 TFLOPS	19.5 TFLOPS	19.5 TFLOPS
FP32	19.5 TFLOPS	19.5 TFLOPS	19.5 TFLOPS	19.5 TFLOPS
Tensor Float 32 (TF32)	156 TFLOPS, 312 TFLOPS*	156 TFLOPS, 312 TFLOPS*	156 TFLOPS, 312 TFLOPS*	156 TFLOPS, 312 TFLOPS*
BFLOAT16 Tensor Core	312 TFLOPS, 624 TFLOPS*	312 TFLOPS, 624 TFLOPS*	312 TFLOPS, 624 TFLOPS*	312 TFLOPS, 624 TFLOPS*
FP16 Tensor Core	312 TFLOPS, 624 TFLOPS*	312 TFLOPS, 624 TFLOPS*	312 TFLOPS, 624 TFLOPS*	312 TFLOPS, 624 TFLOPS*
INT8 Tensor Core	624 TOPS, 1248 TOPS*	624 TOPS, 1248 TOPS*	624 TOPS, 1248 TOPS*	624 TOPS, 1248 TOPS*
GPU Memory	40GB HBM2	80GB HBM2e	40GB HBM2	80GB HBM2e
GPU Memory Bandwidth	1,555GB/s	1,935GB/s	1,555GB/s	2,039GB/s
Max Thermal Design Power (TDP)	250W	300W	400W	400W
Multi-Instance GPU	Up to 7 MIGs @ 5GB	Up to 7 MIGs @ 10GB	Up to 7 MIGs @ 5GB	Up to 7 MIGs @ 10GB
Form Factor	PCIe	PCIe	SXM	SXM
Interconnect	NVIDIA® NVLink® Bridge for 2 GPUs: 600GB/s**, PCIe Gen4: 64GB/s	NVIDIA® NVLink® Bridge for 2 GPUs: 600GB/s**, PCIe Gen4: 64GB/s	NVLink: 600GB/s, PCIe Gen4: 64GB/s	NVLink: 600GB/s, PCIe Gen4: 64GB/s
Server Options	Partner and NVIDIA-Certified Systems™ with 1-8 GPUs	Partner and NVIDIA-Certified Systems™ with 1-8 GPUs	NVIDIA HGX™ A100-Partner and NVIDIA-Certified Systems with 4, 8, or 16 GPUs, NVIDIA DGX™ A100 with 8 GPUs	NVIDIA HGX™ A100-Partner and NVIDIA-Certified Systems with 4, 8, or 16 GPUs, NVIDIA DGX™ A100 with 8 GPUs