Overview
Nvidia A40
|
Nvidia B200
|
|
|---|---|---|
| Summary | Data center GPU for large-batch inference and professional visualization. | High-end Blackwell GPU for large-scale AI training and inference. |
| Architecture | Ampere | Blackwell |
| Memory | 48GB GDDR6 | Up to 192GB HBM3e |
| Memory Bandwidth | 696 GB/s | 8,000 GB/s |
| Performance | 150 TFLOPS (FP16) | 9,000 TFLOPS (FP8) |
| Release Date | Q4 2020 | Q1 2024 |
| Performance Segment | Mid-Range | High Performance |
| Datasheet | Link | Link |
Price comparison
A40 Pricing
For smaller projects, the A40 is available around $0.23/hr per GPU (spot instance). This tier offers a 89% discount compared to the higher end of the market ($2.14/hr).
How we sort results
Default ranking
Our algorithm weighs five factors to find the most relevant matches for you:
- Price: We blend total hourly price with price-per-GPU to balance affordability and value.
- Specs: We favor offers with higher CPU, RAM, and GPU Memory.
- Billing: We favor on-demand billing for simplicity and flexibility over spot instances, reservations, and custom quotes.
- Location: We blend both datacenter proximity and provider HQ location. Datacenter location matters for latency, while HQ location matters for compliance and support.
- Provider diversity: Each time a provider appears in the list, their subsequent offerings are ranked a little lower, so one provider's offerings don't crowd out the top positions.
Sorting and filtering
Click "View all offerings" to access the full list with sortable columns and filters for billing type, GPU count, vCPUs, and RAM.
Transparency and funding
Ads and sponsors: Any paid placements are fixed at the top and clearly labeled as sponsored content.
Affiliates: Any affiliate links will be indicated to you as well. We may earn a commission if you click them, but this never influences the ranking order.
| Provider | GPUs | Billing | Total/h | |
|---|---|---|---|---|
Vast.ai
Our sponsor
|
2x | On-Demand Pay-as-you-go pricing. No term commitments. | $0.57 | View |
Crusoe
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $0.90 | View |
Vultr
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $1.71 | View |
Database Mart
|
1x | Reserved (1mo) Reserved capacity with a 1-month minimum commitment. | $0.76 | View |
|
Vultr
|
4x | On-Demand Pay-as-you-go pricing. No term commitments. | $6.85 | View |
Exoscale
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $2.14 | View |
|
Crusoe
|
1x | Spot Variable spot pricing with potential interruptions. | $0.40 | View |
|
Vast.ai
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $0.44 | View |
|
Vast.ai
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $0.32 | View |
|
Exoscale
|
2x | On-Demand Pay-as-you-go pricing. No term commitments. | $4.27 | View |
|
Vast.ai
|
2x | On-Demand Pay-as-you-go pricing. No term commitments. | $0.57 | View |
|
Vast.ai
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $0.44 | View |
|
Exoscale
|
4x | On-Demand Pay-as-you-go pricing. No term commitments. | $8.54 | View |
|
Vast.ai
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $0.60 | View |
|
Vast.ai
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $0.60 | View |
| No offerings matching your filters. | ||||
B200 Pricing
We're tracking 24 cloud providers for the B200, and the pricing spread is significant. While the average sits at $4.93/hr, the lowest price is currently $2.25/hr per GPU (36-month reservation).
How we sort results
Default ranking
Our algorithm weighs five factors to find the most relevant matches for you:
- Price: We blend total hourly price with price-per-GPU to balance affordability and value.
- Specs: We favor offers with higher CPU, RAM, and GPU Memory.
- Billing: We favor on-demand billing for simplicity and flexibility over spot instances, reservations, and custom quotes.
- Location: We blend both datacenter proximity and provider HQ location. Datacenter location matters for latency, while HQ location matters for compliance and support.
- Provider diversity: Each time a provider appears in the list, their subsequent offerings are ranked a little lower, so one provider's offerings don't crowd out the top positions.
Sorting and filtering
Click "View all offerings" to access the full list with sortable columns and filters for billing type, GPU count, vCPUs, and RAM.
Transparency and funding
Ads and sponsors: Any paid placements are fixed at the top and clearly labeled as sponsored content.
Affiliates: Any affiliate links will be indicated to you as well. We may earn a commission if you click them, but this never influences the ranking order.
| Provider | GPUs | Billing | Total/h | |
|---|---|---|---|---|
Packet·ai
Our sponsor
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $3.75 | View |
Runpod
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $5.89 | View |
Lambda Labs
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $6.99 | View |
CoreWeave
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $8.60 | View |
UpCloud
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $5.16 | View |
|
Runpod
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $5.98 | View |
Nebius
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $7.15 | View |
Koyeb
|
1x | On-Demand Pay-as-you-go pricing. No term commitments. | $5.50 | View |
|
Lambda Labs
|
2x | On-Demand Pay-as-you-go pricing. No term commitments. | $13.78 | View |
Oracle Cloud
|
8x | On-Demand Pay-as-you-go pricing. No term commitments. | $112.00 | View |
AWS
|
8x | On-Demand Pay-as-you-go pricing. No term commitments. | $113.93 | View |
|
CoreWeave
|
8x | On-Demand Pay-as-you-go pricing. No term commitments. | $68.80 | View |
Google Cloud
|
8x | On-Demand Pay-as-you-go pricing. No term commitments. | $128.88 | View |
|
UpCloud
|
2x | On-Demand Pay-as-you-go pricing. No term commitments. | $10.31 | View |
Lyceum
|
1x | On-Demand Per GPU, per hour. Instances configurable from 1 to 8 GPUs with per-second billing. | $6.49 | View |
| No offerings matching your filters. | ||||
Heads up: We do our best to keep these specs & prices accurate. However, cloud costs may fluctuate based on region, usage, and other factors not listed here. These are estimates based on common setups and are for informational purposes only. Always verify current rates & exact specs with the provider before provisioning.
Alternative GPUs
Here's how these GPUs compare against alternatives:
Nvidia A40
vs
Nvidia L40
Nvidia A40
vs
Nvidia A5000
Nvidia B200
vs
Nvidia H200
Nvidia B200
vs
Nvidia H100
Our data for Nvidia A40 was last updated on March 25, 2026, and for Nvidia B200 on March 25, 2026.