Vast.ai Our sponsor
USA 10 configs 1x-4x
Entry-level Blackwell professional GPU for AI prototyping.
Barriers to entry are low here. 3 cloud providers list the RTX PRO 4000 with prices starting at just $0.20/hr per GPU (on-demand), making it accessible for testing without a large commitment. Spot instances start lower, at $0.14/hr per GPU.
USA 10 configs 1x-4x
USA 4 configs 1x-8x
USA 3 configs 1x
Heads up: We do our best to keep these specs & prices accurate. However, cloud costs may fluctuate based on region, usage, and other factors not listed here. These are estimates based on common setups and are for informational purposes only. Always verify current rates & exact specs with the provider before provisioning.
24GB GDDR7 with Blackwell FP4 Tensor Cores. Entry-level Blackwell professional GPU for AI prototyping and visualization.
Limited VRAM for larger models. Desktop form factor with minimal cloud availability.
The median on-demand price across providers has risen about 98% since January 2026, from $0.20 to $0.40/hr per GPU. This reflects the market-wide median, which moves both when providers change prices and when lower or higher priced offerings enter the market.
With 24GB of VRAM, the RTX PRO 4000 can typically run 7B to 13B models in FP16, or larger models in 4-bit quantized form.
The RTX PRO 4000 has 24GB of VRAM. Multi-GPU setups increase total memory, but that memory is not automatically pooled across GPUs.
The RTX PRO 4000 has 672 GB/s of memory bandwidth. Higher bandwidth helps with faster data transfer between GPU memory and compute cores.
The RTX PRO 4000 supports 7 precision formats. Training: BF16, FP16, TF32, FP32. Inference: FP4, FP8, INT8.
No. The RTX PRO 4000 is a PCIe-only GPU with no NVLink, so it is better suited to single-GPU inference and smaller-scale workloads than large distributed training jobs.
RTX PRO 4000 pricing currently ranges from $0.14/hr to $0.57/hr per GPU, depending on the provider, instance type, and billing model.
At 720 hours per month, one RTX PRO 4000 can cost between $98.64 to $410.40 per month, depending on the provider. Reserved and spot pricing can lower that further.
The RTX PRO 4000 is available from 3 cloud providers: Runpod, Database Mart, Vast.ai.
Yes. We currently track 17 RTX PRO 4000 listings across 3 cloud providers:
| Billing type | Listings | Avg $/GPU/hr |
|---|---|---|
| On-demand | 7 | $0.37/hr |
| Reserved | 7 | $0.26/hr |
| Spot | 3 | $0.18/hr |
| GPU Memory | 24GB GDDR7 |
| Memory Interface | 192-bit |
| Memory Bandwidth | 672 GB/s |
| CUDA Cores | 8,960 |
| Tensor Cores | 5th generation |
| RT Cores | 4th generation |
| Single-Precision Performance | 37 TFLOPS |
| RT Core Performance | 112 TFLOPS |
| AI Performance | 1,178 AI TOPS |
| System Interface | PCIe 5.0 x16 |
| Power Consumption | Total board power: 145 W |
| Thermal Solution | Active |
| Form Factor | 4.4" x 9.5" L, single slot, full height |
| Display Connectors | 4x DisplayPort 2.1b |
| Max Simultaneous Displays | 4x 3840 x 2160 @ 165 Hz, 2x 7680 x 4320 @ 100 Hz |
| Power Connector | 1x PCIe CEM5 16-pin |
| NVENC | 2x (9th generation) |
| NVDEC | 2x (6th generation) |
| Graphics APIs | DirectX 12, Shader Model 6.6, OpenGL 4.6, Vulkan 1.3 |
| Compute APIs | CUDA 12.8, OpenCL 3.0, DirectCompute |
Last updated