Nvidia RTX 4060
Budget Ada Lovelace GPU for basic local inference.
- Arch
- Ada Lovelace
- Memory
- 8 GB GDDR6
- Bandwidth
- 272 GB/s
- Released
- Q2 2023
Price history
Weekly median price per GPU per hour
Aggregating historical prices...
At a glance Updated 8 minutes ago
- Cheapest in stock
- $0.07 /GPU/hr
- on-demand · 4x · Vast.ai
- Median price (current)
- $0.08 /GPU/hr
- on-demand
- 90-day trend
- --
- Coverage
- 4 providers
- 15 price points
Pricing & availability
How this list works
The two views
By provider shows one card per company, placed where its best offer ranked. By configuration lists every offer.
Order
What you can rent comes first: in stock, then waitlist, then not reported, then out of stock. Priced offers rank ahead of quote-only, and on-demand ahead of other billing types.
Within a group, five factors set the order:
- Location: datacenter proximity, blended with provider HQ.
- Price: hourly price, per GPU and in total.
- Billing type: reserved ahead of spot, spot ahead of quote-only.
- Specs: more VRAM, vCPUs and RAM.
- Provider diversity: a provider's repeat rows rank slightly lower, so one company can't take all the top spots.
Search
We match the provider, its country, GPU model, form factor, billing type, availability and instance name. Matching is partial and case-insensitive. Everyday words work too, so "interruptible" finds spot and "sold out" finds out of stock.
Transparency and funding
- Ads and sponsors: Paid placements sit at the top of the list and are always labeled as sponsored content. Sponsorship never influences the organic ranking itself.
- Affiliates: Affiliate links are marked. We may earn a commission if you click them, but commissions never affect the order.
- Prices: Shown in USD, converted at daily reference rates where a provider publishes in another currency. A month means 720 hours. How we estimate costs.
Heads up: A provider's own page may quote a different figure, for example on tax, region or a promotion. A monthly-only plan shows a derived hourly rate. Verify before provisioning. More on how we price.
What can the RTX 4060 run?
One RTX 4060 has 8 GB of VRAM. In practice, that's enough memory for roughly 2B parameters at 4-bit, assuming a 32K context. Below are some open-weight LLMs, with the estimated memory and GPUs each one needs.
Multi-node
| Model | Memory (INT4 / FP4) | RTX 4060s needed | Cost /hr | Cost /mo |
|---|---|---|---|---|
Qwen3.8-27B
27B
|
18 GB
|
3
|
–
|
–
|
Gemma 4 31B
30.7B
|
22 GB
|
3
|
–
|
–
|
GPT-OSS-120B
117B · 5.1B active
|
67 GB
|
10
|
–
|
–
|
GLM-5.3-Flash
320B · 18B active
|
178 GB
|
25
|
–
|
–
|
MiniMax-M3
428B · 23B active
|
239 GB
|
34
|
–
|
–
|
DeepSeek V4.1 Flash
552B · 16B active
|
306 GB
|
43
|
–
|
–
|
Kimi K3
2.8T · 104B active
|
1,544 GB
|
215
|
–
|
–
|
Estimates based on the median on-demand rate. Memory is weights plus FP8 KV cache at 32K context per request (FP16/BF16 in the 16-bit column). GPU counts assume 90% of advertised VRAM is usable. No guarantee of runtime support, usable performance, or that a matching quantized build exists. How we estimate costs.
Technical Specifications
Nvidia RTX 4060 · Per GPU
| Compute · dense | |
|---|---|
| FP8 | 60.5 TFLOPS 120.9 with sparsity |
| FP16 / BF16 | 30.2 TFLOPS 60.5 with sparsity |
| INT8 | 120.9 TOPS 241.8 with sparsity |
| FP32 | 15.1 TFLOPS |
| Precision support | FP8FP16BF16TF32FP32INT4INT8 |
| Memory | |
|---|---|
| Capacity | 8 GB GDDR6 |
| Bandwidth | 272 GB/s |
| Bus width | 128-bit |
| ECC | No |
| Silicon | |
|---|---|
| Architecture | Ada Lovelace |
| Process | TSMC 4N |
| Transistors | 18.9 billion |
| Shader cores | 3,072 CUDA cores |
| Matrix cores | 96 Tensor cores |
| Compute units | 24 SMs |
| Fabric and host | |
|---|---|
| Host interface | PCIe 4.0 x8 |
| Power | |
|---|---|
| Board power | 115 W |
| Cooling | Active |
Source: official Nvidia RTX 4060 datasheet.
Frequently Asked Questions
How much does the RTX 4060 cost per hour?
-
As of September 13, 2026, the median on-demand price is $0.08 per GPU per hour across 3 providers.
Billing type Configs Median /GPU/hr Cheapest On-demand
6
$0.08
$0.07 (in stock, Vast.ai)
Reserved
4
$0.21 (24 mo)
Spot
5
$0.03 (in stock, Vast.ai)
No median for reserved and spot: we only show this when at least 3 providers list the GPU on that billing type.
Who has the cheapest RTX 4060?
How much does the RTX 4060 cost per month?
-
At 720 hours per month, one RTX 4060 costs an estimated $58 at the median on-demand price. Cheapest verified in stock: $50 per month on-demand, $22 spot.
Where can I rent an RTX 4060?
-
GetDeploying currently tracks RTX 4060 configs from 4 providers. The cheapest verified in-stock on-demand configs come from Vast.ai, Salad and Theta EdgeCloud. See the full price comparison above for every provider and config.
How many RTX 4060 GPUs do I need?
-
One RTX 4060 runs models up to roughly 2B parameters at 4-bit quantization, assuming a 32K context. Larger models run across multiple GPUs: the model table above shows the estimated memory and GPU count for popular open-weight LLMs.
Why choose the RTX 4060?
-
8GB GDDR6 with Ada Lovelace architecture. Budget option for basic local AI tasks.
When is the RTX 4060 not a good fit?
-
8GB VRAM is too small for most AI models. Better suited for basic local experimentation than production or serious development.
Alternatives to Nvidia RTX 4060
Last updated