Nvidia RTX 3060 Ti vs Nvidia V100

The V100 has 4x the memory and 2x the bandwidth. The RTX 3060 Ti is newer and cheaper right now.

At a glance

Memory

4x more on V100

RTX 3060 Ti: 8 GB

V100: 32 GB

Memory bandwidth

2x higher on V100

RTX 3060 Ti: 448 GB/s

V100: 900 GB/s

Cheapest on-demand

31% cheaper on RTX 3060 Ti

RTX 3060 Ti: $0.06 /GPU/hr

V100: $0.08 /GPU/hr

Price comparison

Median price per GPU per hour by billing type, with the cheapest listing under it.

Billing	RTX 3060 Ti	V100
On-demand	-- /GPU/hr from $0.06	$0.95 /GPU/hr from $0.08
Reserved	-- /GPU/hr from $0.11 (3 mo)	$0.97 /GPU/hr from $0.14 (24 mo)
Spot	-- /GPU/hr from $0.03	$0.40 /GPU/hr from $0.09

Heads up: A provider's own page may quote a different figure, for example on tax, region or a promotion. A monthly-only plan shows a derived hourly rate. Medians are across providers, one vote each, so a large catalog does not outweigh a small one. No median for on-demand, reserved and spot on the RTX 3060 Ti: we only show one when at least 3 providers list the GPU on that billing type. Verify before provisioning. More on how we price.

Price history

RTX 3060 Ti vs V100 price history

Weekly median on-demand price per GPU per hour

Last 12 months

Aggregating historical prices...

Specs comparison

Spec	RTX 3060 Ti	V100	Difference
Memory
Capacity	8 GB GDDR6	32 GB HBM2	4x more on V100
Bandwidth	448 GB/s	900 GB/s	2x higher on V100
Bus width	256-bit	4,096-bit	16x wider on V100
Compute · dense
FP16 / BF16	32.4 TFLOPS	125 TFLOPS	3.9x higher on V100
INT8	129.6 TOPS
FP32	16.2 TFLOPS	15.7 TFLOPS	Within 5%
FP64	Not supported	7.8 TFLOPS	V100 only
Platform
Interconnect	PCIe only	NVLink 300 GB/s	NVLink on V100 only
Board power	200 W	300 W	50% higher on V100
Released	Q4 2020	Q2 2017	3 years newer on RTX 3060 Ti
Precision
Supported formats	FP16BF16TF32FP32INT4INT8	FP16FP32FP64INT8

Figures are for each model's headline configuration. Where a form factor carries a different number, it is named under the figure.

Compute: Vendor peak figures, dense and per GPU. Not measured throughput.

Source: RTX 3060 Ti datasheet and V100 datasheet.

Where to rent them

Providers that rent these GPUs, with each one's cheapest rate. Providers that rent both are listed first.

Provider	RTX 3060 Ti	V100
Vast.ai USA	$0.06 /GPU/hr On-demand	$0.08 /GPU/hr On-demand
Salad Distributed	$0.08 /GPU/hr On-demand	--
Database Mart USA	$0.25 /GPU/hr Reserved	--
GPU.ai UAE	--	$0.09 /GPU/hr On-demand
HyperAI Hong Kong	--	$0.14 /GPU/hr On-demand
Verda Finland	--	$0.19 /GPU/hr On-demand
Runpod USA	--	$0.23 /GPU/hr On-demand SXM
Sesterce France	--	$2.57 /GPU/hr On-demand
Runcrate USA	--	$3.04 /GPU/hr On-demand NVL
Geodd USA	--	$0.16 /GPU/hr On-demand