Vast.ai Our sponsor
USA 15 configs 1x-8x
Popular legacy consumer GPU for local AI development with NVLink.
You can start using a RTX 3090 for $0.09/hr per GPU (on-demand). It's a low-risk price point for smaller workloads compared to the market high of $0.50/hr. Spot instances start lower, at $0.05/hr per GPU.
USA 15 configs 1x-8x
USA 1 config 1x
USA 5 configs 1x-8x
UAE 4 configs 1x-8x
Hong Kong 8 configs 1x-8x
USA 1 config 1x
USA 1 config 1x
Switzerland 1 config 1x
Heads up: We do our best to keep these specs & prices accurate. However, cloud costs may fluctuate based on region, usage, and other factors not listed here. These are estimates based on common setups and are for informational purposes only. Always verify current rates & exact specs with the provider before provisioning.
24GB GDDR6X with NVLink support (112 GB/s). One of few consumer GPUs supporting NVLink for 2-GPU configurations. Popular legacy choice for AI researchers.
Ampere consumer GPU - no FP8. High power consumption. Subject to Nvidia's consumer EULA, which may restrict data center use. For new setups, the RTX 4090 or RTX 5090 are significantly faster.
The median on-demand price across providers has fallen about 25% since August 2025, from $0.17 to $0.13/hr per GPU. This reflects the market-wide median, which moves both when providers change prices and when lower or higher priced offerings enter the market.
With 24GB of VRAM, the RTX 3090 can typically run 7B to 13B models in FP16, or larger models in 4-bit quantized form.
The RTX 3090 has 24GB of VRAM. Multi-GPU setups increase total memory, but that memory is not automatically pooled across GPUs.
The RTX 3090 has 936 GB/s of memory bandwidth. Higher bandwidth helps with faster data transfer between GPU memory and compute cores.
The RTX 3090 supports 6 precision formats. Training: BF16, FP16, TF32, FP32. Inference: INT4, INT8.
Yes. The RTX 3090 supports NVLink with 112 GB/s of bidirectional bandwidth. This helps accelerate multi-GPU communication.
RTX 3090 pricing currently ranges from $0.05/hr to $0.50/hr per GPU, depending on the provider, instance type, and billing model.
At 720 hours per month, one RTX 3090 can cost between $38.66 to $360.00 per month, depending on the provider. Reserved and spot pricing can lower that further.
The RTX 3090 is available from 8 cloud providers, including Runpod, Salad, SwissGPU. Pricing and availability vary by region and billing model.
Yes. We currently track 36 RTX 3090 listings across 8 cloud providers:
| Billing type | Listings | Avg $/GPU/hr |
|---|---|---|
| On-demand | 21 | $0.18/hr |
| Reserved | 9 | $0.09/hr |
| Spot | 6 | $0.09/hr |
| Architecture | Ampere |
| CUDA Cores | 10496 |
| Memory Size | 24 GB |
| Memory Type | GDDR6X |
| Memory Bandwidth | 936.2 GB/s |
| TDP | 350W |
Source: official Nvidia RTX 3090 datasheet.
Last updated