Nvidia T4G

Compare prices for Nvidia T4G across cloud providers

Dec. 11, 2024 (updated)

A variant of the T4, the Nvidia T4G is optimized for inference workloads, focusing on cost-effective cloud-based AI applications. Its design supports real-time processing efficiently.

Provider GPUs VRAM vCPUs RAM Price/h
Amazon Web Services logo AWS 1x T4G 16GB 4 16GB $0.42 Source
Amazon Web Services logo AWS 1x T4G 16GB 4 16GB $0.53 Source
Amazon Web Services logo AWS 1x T4G 16GB 8 16GB $0.56 Source
Amazon Web Services logo AWS 1x T4G 16GB 8 32GB $0.75 Source
Amazon Web Services logo AWS 1x T4G 16GB 16 16GB $0.83 Source
Amazon Web Services logo AWS 1x T4G 16GB 16 64GB $1.20 Source
Amazon Web Services logo AWS 1x T4G 16GB 32 16GB $1.37 Source
Amazon Web Services logo AWS 1x T4G 16GB 32 128GB $2.18 Source
Amazon Web Services logo AWS 2x T4G 32GB 64 32GB $2.74 Source
Amazon Web Services logo AWS 4x T4G 64GB 48 192GB $3.92 Source
AWS 1x T4G 16GB 64 256GB $4.35 Source
AWS 8x T4G 128GB 96 384GB $7.83 Source

Note: Prices are subject to change and may vary by region and other factors not listed here. For some GPUs, I include links to Shadeform (the sponsor) so you can check if they're available right now. I don’t earn a commission when you click on these links, but their monthly sponsorship helps me keep the site running.

Nvidia T4G specs

FP32 8.1 TF
FP16 Tensor Core 16.3 TF
INT8 Tensor Core 32.5 TOPS
INT4 Tensor Core 65 TOPS
RT Cores 40
Encode / Decode 1 encoder, 2 decoder
GPU Memory 16 GB GDDR6
GPU Memory Bandwidth 320 GB/s
Interconnect x16 PCIe Gen3
Form Factor 1-slot Low Profile PCIe
Max TDP Power 70W

Source: official Nvidia T4G datasheet.