Nvidia T4
Last updated on Oct. 14, 2024
Price Comparison
Provider | GPUs | VRAM | vCPUs | RAM | Price/h | |
---|---|---|---|---|---|---|
Azure | 1x T4 | 16GB | 4 | 28GB | $0.53 | Source |
Azure | 1x T4 | 16GB | 8 | 56GB | $0.75 | Source |
Replicate | 1x T4 | 16GB | 4 | 16GB | $0.81 | Source |
Alibaba Cloud | 1x T4 | 16GB | 4 | 15GB | $1.18 | Source |
Azure | 1x T4 | 16GB | 16 | 110GB | $1.20 | Source |
Azure | 4x T4 | 64GB | 64 | 440GB | $4.35 | Source |
Note: Prices are subject to change, and may vary by region and other factors not listed here. I included links to launch GPUs using Shadeform (sponsor) so you can check if they're available right now. There are no fees to use their service.
Specifications
GPU Architecture | NVIDIA Turing |
NVIDIA Turing Tensor Cores | 320 |
NVIDIA CUDA® Cores | 2,560 |
Single-Precision | 8.1 TFLOPS |
Mixed-Precision (FP16/FP32) | 65 TFLOPS |
INT8 | 130 TOPS |
INT4 | 260 TOPS |
GPU Memory | 16 GB GDDR6 |
Memory Bandwidth | 300 GB/sec |
ECC | Yes |
Interconnect Bandwidth | 32 GB/sec |
System Interface | x16 PCIe Gen3 |
Form Factor | Low-Profile PCIe |
Thermal Solution | Passive |
Compute APIs | CUDA, NVIDIA TensorRT™, ONNX |
Source: official Nvidia T4 datasheet.