Overview

Nvidia logo Nvidia A100 Nvidia logo Nvidia B100
Summary Previous-gen data center workhorse for AI training and inference. Blackwell data center GPU for next-generation AI training and inference.
Architecture Ampere Blackwell
Memory 40GB / 80GB HBM2e Up to 192GB HBM3e
Memory Bandwidth 1,935 GB/s 8,000 GB/s
Performance 312 TFLOPS (FP16) --
Release Date Q2 2020 Q4 2024
Performance Segment High Performance High Performance
Datasheet Link Link

Price comparison

Nvidia A100 logo A100 Pricing

There is a 92% difference between the highest and lowest listings for the A100. You can pay up to $5.04/hr, but the market floor is currently $0.40/hr per GPU (spot instance).

Default ranking

Our algorithm weighs five factors to find the most relevant matches for you:

  1. Price: We blend total hourly price with price-per-GPU to balance affordability and value.
  2. Specs: We favor offers with higher CPU, RAM, and GPU Memory.
  3. Billing: We favor on-demand billing for simplicity and flexibility over spot instances, reservations, and custom quotes.
  4. Location: We blend both datacenter proximity and provider HQ location. Datacenter location matters for latency, while HQ location matters for compliance and support.
  5. Provider diversity: Each time a provider appears in the list, their subsequent offerings are ranked a little lower, so one provider's offerings don't crowd out the top positions.

Sorting and filtering

Click "View all offerings" to access the full list with sortable columns and filters for billing type, GPU count, vCPUs, and RAM.

Transparency and funding

Ads and sponsors: Any paid placements are fixed at the top and clearly labeled as sponsored content.

Affiliates: Any affiliate links will be indicated to you as well. We may earn a commission if you click them, but this never influences the ranking order.

Provider GPUs Billing Total/h
Packet·ai logo Packet·ai 1x On-Demand Pay-as-you-go pricing. No term commitments. $1.43 View
Novita logo Novita 1x On-Demand Pay-as-you-go pricing. No term commitments. $1.60 View
Crusoe logo Crusoe 1x On-Demand Pay-as-you-go pricing. No term commitments. $1.65 View
Theta EdgeCloud logo Theta EdgeCloud 1x On-Demand Pay-as-you-go pricing. No term commitments. $1.99 View
Vultr logo Vultr 1x On-Demand Pay-as-you-go pricing. No term commitments. $2.40 View
Together logo Together 1x On-Demand Pay-as-you-go pricing. No term commitments. $2.40 View
Lambda Labs logo Lambda Labs 1x On-Demand Pay-as-you-go pricing. No term commitments. $1.99 View
Thunder Compute logo Thunder Compute 1x On-Demand Pay-as-you-go pricing. No term commitments. $0.78 View
Fly.io logo Fly.io 1x On-Demand Pay-as-you-go pricing. No term commitments. $2.50 View
Paperspace logo Paperspace 1x On-Demand Pay-as-you-go pricing. No term commitments. $3.28 View
Runpod logo Runpod 1x On-Demand Pay-as-you-go pricing. No term commitments. $1.39 View
Microsoft Azure logo Azure 1x On-Demand Pay-as-you-go pricing. No term commitments. $3.67 View
Hyperstack logo Hyperstack 1x On-Demand Pay-as-you-go pricing. No term commitments. $1.35 View
CUDO Compute logo CUDO 1x On-Demand Pay-as-you-go pricing. No term commitments. $1.35 View
No offerings matching your filters.

Nvidia B100 logo B100 Pricing

The B100 is listed by 1 cloud provider, but none offer public on-demand pricing.

Default ranking

Our algorithm weighs five factors to find the most relevant matches for you:

  1. Price: We blend total hourly price with price-per-GPU to balance affordability and value.
  2. Specs: We favor offers with higher CPU, RAM, and GPU Memory.
  3. Billing: We favor on-demand billing for simplicity and flexibility over spot instances, reservations, and custom quotes.
  4. Location: We blend both datacenter proximity and provider HQ location. Datacenter location matters for latency, while HQ location matters for compliance and support.
  5. Provider diversity: Each time a provider appears in the list, their subsequent offerings are ranked a little lower, so one provider's offerings don't crowd out the top positions.

Sorting and filtering

Click "View all offerings" to access the full list with sortable columns and filters for billing type, GPU count, vCPUs, and RAM.

Transparency and funding

Ads and sponsors: Any paid placements are fixed at the top and clearly labeled as sponsored content.

Affiliates: Any affiliate links will be indicated to you as well. We may earn a commission if you click them, but this never influences the ranking order.

Provider GPUs Billing Total/h
CUDO Compute logo CUDO 1x Custom Custom terms negotiated with the provider. Custom View
No offerings matching your filters.

Heads up: We do our best to keep these prices accurate. However, cloud costs may fluctuate based on region, usage, and other factors not listed here. These are estimates based on common setups and are for informational purposes only. Always verify current rates with the provider before provisioning.

Alternative GPUs

Here's how these GPUs compare against alternatives:

View all GPUs

Our data for Nvidia A100 was last updated on March 25, 2026, and for Nvidia B100 on March 25, 2026.