Vast.ai
Our sponsor- On-Demand
- from $0.13
- Reserved
- from $0.12
- Spot
- from $0.13
Turing professional GPU for rendering and visualization.
Weekly median price per GPU per hour
By provider shows one card per company, placed where its best offer ranked. By configuration lists every offer.
What you can rent comes first: in stock, then waitlist, then not reported, then out of stock. Priced offers rank ahead of quote-only, and on-demand ahead of other billing types.
Within a group, five factors set the order:
We match the provider, its country, GPU model, form factor, billing type, availability and instance name. Matching is partial and case-insensitive. Everyday words work too, so "interruptible" finds spot and "sold out" finds out of stock.
No providers match .
Heads up: A provider's own page may quote a different figure, for example on tax, region or a promotion. A monthly-only plan shows a derived hourly rate. Verify before provisioning. More on how we price.
One Quadro RTX 6000 has 24 GB of VRAM. In practice, that's enough memory for roughly 21B parameters at 4-bit or 6B at 16-bit, assuming a 32K context. Below are some open-weight LLMs, with the estimated memory and GPUs each one needs.
| Model | Memory (INT4 / FP4) | Quadro RTX 6000s needed | Cost /hr | Cost /mo |
|---|---|---|---|---|
|
|
19 GB
|
1
|
–
|
–
|
|
|
24 GB
|
2
|
–
|
–
|
|
|
68 GB
|
4
|
–
|
–
|
|
|
178 GB
|
9
|
–
|
–
|
|
|
241 GB
|
12
|
–
|
–
|
|
|
306 GB
|
15
|
–
|
–
|
|
|
1,545 GB
|
72
|
–
|
–
|
Estimates based on the median on-demand rate. Memory is weights plus FP16/BF16 KV cache at 32K context per request. GPU counts assume 90% of advertised VRAM is usable. No guarantee of runtime support, usable performance, or that a matching quantized build exists. How we estimate costs.
Nvidia Quadro RTX 6000 · Per GPU
| Compute · dense | |
|---|---|
| FP16 / BF16 | 130.5 TFLOPS |
| INT8 | 261 TOPS |
| FP32 | 16.3 TFLOPS |
| Precision support | FP16FP32INT4INT8 |
| Memory | |
|---|---|
| Capacity | 24 GB GDDR6 |
| Bandwidth | 672 GB/s |
| Bus width | 384-bit |
| ECC | Yes |
| Silicon | |
|---|---|
| Architecture | Turing |
| Process | TSMC 12nm FFN |
| Transistors | 18.6 billion |
| Shader cores | 4,608 CUDA cores |
| Matrix cores | 576 Tensor cores |
| Compute units | 72 SMs |
| Fabric and host | |
|---|---|
| GPU interconnect | NVLink 100 GB/s |
| Host interface | PCIe 3.0 x16 |
| Power | |
|---|---|
| Board power | 295 W |
| Cooling | Active |
As of September 18, 2026, we track 33 configs from 3 providers. Prices are per GPU per hour.
| Billing type | Configs | Cheapest |
|---|---|---|
On-demand | 10 | $0.13 (in stock, Vast.ai) |
Reserved | 20 | $0.12 (12 mo, in stock, Vast.ai) |
Spot | 3 | $0.13 (in stock, Vast.ai) |
No median for on-demand, reserved and spot: we only show this when at least 3 providers list the GPU on that billing type.
The cheapest verified in-stock estimate is $94 per month on-demand, $86 reserved (12 mo), $94 spot.
GetDeploying currently tracks Quadro RTX 6000 configs from 3 providers. Vast.ai has verified in-stock on-demand configs. See the full price comparison above for every provider and config.
One Quadro RTX 6000 runs models up to roughly 21B parameters at 4-bit quantization or 6B at 16-bit, assuming a 32K context. Larger models run across multiple GPUs: the model table above shows the estimated memory and GPU count for popular open-weight LLMs.
24GB GDDR6 with NVLink (112 GB/s). Turing professional GPU with RT cores for ray tracing and rendering.
Turing architecture lacks BF16 and FP8. For AI workloads, the RTX 6000 Ada or A6000 offers significantly better performance.
Last updated