Key Specifications
Compare Cloud Provider Prices
You can start using a T4G for $0.23/hr per GPU (36-month reservation). It's a low-risk price point for smaller workloads compared to the market high of $1.37/hr.
How we sort results
Default ranking
Our algorithm weighs five factors to find the most relevant matches for you:
- Price: We blend total hourly price with price-per-GPU to balance affordability and value.
- Specs: We favor offers with higher CPU, RAM, and GPU Memory.
- Billing: We favor on-demand billing for simplicity and flexibility over spot instances, reservations, and custom quotes.
- Location: We blend both datacenter proximity and provider HQ location. Datacenter location matters for latency, while HQ location matters for compliance and support.
- Provider diversity: Each time a provider appears in the list, their subsequent offerings are ranked a little lower, so one provider's offerings don't crowd out the top positions.
Sorting and filtering
Click any column header to sort by that column. Use the filters above the table to narrow results by billing type, GPU count, vCPUs, or RAM. Custom sorting resets the default relevance ranking.
Transparency and funding
Ads and sponsors: Any paid placements are fixed at the top and clearly labeled as sponsored content.
Affiliates: Any affiliate links will be indicated to you as well. We may earn a commission if you click them, but this never influences the ranking order.
| Provider | GPUs | Total VRAM | vCPUs | RAM | Billing | $/GPU/h | Total/h | Availability | |
|---|---|---|---|---|---|---|---|---|---|
AWS
|
1x T4G 1x T4G 16GB (g5g.xlarge) | 16GB | 4 | 16GB | On-Demand Pay-as-you-go pricing. No term commitments. | $0.42 | $0.42 | Available | View |
|
AWS
|
1x T4G 1x T4G 16GB (g5g.2xlarge) | 16GB | 8 | 16GB | On-Demand Pay-as-you-go pricing. No term commitments. | $0.56 | $0.56 | Available | View |
|
AWS
|
1x T4G 1x T4G 16GB (g5g.4xlarge) | 16GB | 16 | 32GB | On-Demand Pay-as-you-go pricing. No term commitments. | $0.83 | $0.83 | Available | View |
|
AWS
|
1x T4G 1x T4G 16GB (g5g.xlarge) | 16GB | 4 | 16GB | Reserved (36mo) Reserved capacity with a 3-year minimum commitment. | $0.23 | $0.23 | Available | View |
|
AWS
|
1x T4G 1x T4G 16GB (g5g.2xlarge) | 16GB | 8 | 16GB | Reserved (36mo) Reserved capacity with a 3-year minimum commitment. | $0.30 | $0.30 | Available | View |
|
AWS
|
1x T4G 1x T4G 16GB (g5g.xlarge) | 16GB | 4 | 16GB | Reserved (12mo) Reserved capacity with a 1-year minimum commitment. | $0.33 | $0.33 | Available | View |
|
AWS
|
1x T4G 1x T4G 16GB (g5g.4xlarge) | 16GB | 16 | 32GB | Reserved (36mo) Reserved capacity with a 3-year minimum commitment. | $0.36 | $0.36 | Available | View |
|
AWS
|
1x T4G 1x T4G 16GB (g5g.2xlarge) | 16GB | 8 | 16GB | Reserved (12mo) Reserved capacity with a 1-year minimum commitment. | $0.35 | $0.35 | Available | View |
|
AWS
|
1x T4G 1x T4G 16GB (g5g.8xlarge) | 16GB | 32 | 64GB | On-Demand Pay-as-you-go pricing. No term commitments. | $1.37 | $1.37 | Available | View |
|
AWS
|
1x T4G 1x T4G 16GB (g5g.4xlarge) | 16GB | 16 | 32GB | Reserved (12mo) Reserved capacity with a 1-year minimum commitment. | $0.65 | $0.65 | Available | View |
|
AWS
|
1x T4G 1x T4G 16GB (g5g.8xlarge) | 16GB | 32 | 64GB | Reserved (36mo) Reserved capacity with a 3-year minimum commitment. | $0.74 | $0.74 | Available | View |
|
AWS
|
1x T4G 1x T4G 16GB (g5g.8xlarge) | 16GB | 32 | 64GB | Reserved (12mo) Reserved capacity with a 1-year minimum commitment. | $0.86 | $0.86 | Available | View |
|
AWS
|
2x T4G 2x T4G 16GB (g5g.metal) | 32GB | 64 | 128GB | Reserved (36mo) Reserved capacity with a 3-year minimum commitment. | $0.74 | $1.48 | Available | View |
|
AWS
|
2x T4G 2x T4G 16GB (g5g.16xlarge) | 32GB | 64 | 128GB | Reserved (36mo) Reserved capacity with a 3-year minimum commitment. | $0.74 | $1.48 | Available | View |
|
AWS
|
2x T4G 2x T4G 16GB (g5g.metal) | 32GB | 64 | 128GB | On-Demand Pay-as-you-go pricing. No term commitments. | $1.37 | $2.74 | Available | View |
|
AWS
|
2x T4G 2x T4G 16GB (g5g.16xlarge) | 32GB | 64 | 128GB | On-Demand Pay-as-you-go pricing. No term commitments. | $1.37 | $2.74 | Available | View |
|
AWS
|
2x T4G 2x T4G 16GB (g5g.metal) | 32GB | 64 | 128GB | Reserved (12mo) Reserved capacity with a 1-year minimum commitment. | $1.08 | $2.16 | Available | View |
|
AWS
|
2x T4G 2x T4G 16GB (g5g.16xlarge) | 32GB | 64 | 128GB | Reserved (12mo) Reserved capacity with a 1-year minimum commitment. | $1.08 | $2.16 | Available | View |
| No offerings matching your filters. | |||||||||
Heads up: We do our best to keep these prices accurate. However, cloud costs may fluctuate based on region, usage, and other factors not listed here. These are estimates based on common setups and are for informational purposes only. Always verify current rates with the provider before provisioning.
Frequently Asked Questions
Why choose the T4G?
16GB GDDR6, AWS Graviton-optimized T4 variant. Low-cost inference on ARM-based instances. Good for lightweight models and video processing.
When is the T4G not a good fit?
Same Turing limitations as T4. ARM ecosystem may have compatibility gaps. Limited to AWS Graviton instances.
Are T4G prices going up or down?
On-demand pricing has decreased by about 24% since June 2025, dropping from $1.30 to $0.99/hr per GPU.
What size AI models can the T4G run?
With 16GB of VRAM, the T4G is best for 7B-class models in 4-bit or 8-bit quantized form, and smaller models in FP16.
How much VRAM does the T4G have?
The T4G has 16GB of VRAM. Multi-GPU setups increase total memory, but that memory is not automatically pooled across GPUs.
What is the T4G's memory bandwidth?
The T4G has 320 GB/s of memory bandwidth. Higher bandwidth helps with faster data transfer between GPU memory and compute cores.
What data types does the T4G support?
The T4G supports 4 precision formats. Training: FP16, FP32. Inference: INT4, INT8.
Does the T4G support NVLink?
No. The T4G is a PCIe-only GPU with no NVLink, so it is better suited to single-GPU inference and smaller-scale workloads than large distributed training jobs.
How much does the T4G cost per hour?
T4G pricing currently ranges from $0.23/hr to $1.37/hr per GPU, depending on the provider, instance type, and billing model.
How much does the T4G cost per month?
At 720 hours per month, one T4G can cost between $163.30 to $987.84 per month, depending on the provider. Reserved and spot pricing can lower that further.
Which cloud providers offer the T4G?
The T4G is available from 1 cloud provider: Amazon Web Services.
Can I rent the T4G in the cloud?
Yes. We currently track 18 T4G listings across 1 cloud providers:
Billing type Listings Avg $/GPU/hr On-demand 6 $0.99/hr Reserved 12 $0.62/hr
Technical Specifications
| FP32 | 8.1 TF |
| FP16 Tensor Core | 16.3 TF |
| INT8 Tensor Core | 32.5 TOPS |
| INT4 Tensor Core | 65 TOPS |
| RT Cores | 40 |
| Encode / Decode | 1 encoder, 2 decoder |
| GPU Memory | 16 GB GDDR6 |
| GPU Memory Bandwidth | 320 GB/s |
| Interconnect | x16 PCIe Gen3 |
| Form Factor | 1-slot Low Profile PCIe |
| Max TDP Power | 70W |
Source: official Nvidia T4G datasheet.
Alternatives to Nvidia T4G
Last updated