Nvidia A10G

Compare prices for Nvidia A10G across cloud providers

Dec. 11, 2024 (updated)

The Nvidia A10G is tailored for cloud providers, combining AI training and graphics capabilities for medium-scale workloads. Nvidia positions it as an effective solution for both training and deployment in the cloud.

Provider GPUs VRAM vCPUs RAM Price/h
Lambda Labs logo Lambda Labs 1x A10G 24GB 30 200GB $0.75 Launch
Amazon Web Services logo AWS 1x A10G 24GB 4 16GB $1.01 Source
Amazon Web Services logo AWS 1x A10G 24GB 8 32GB $1.21 Source
Amazon Web Services logo AWS 1x A10G 24GB 16 64GB $1.63 Source
Amazon Web Services logo AWS 1x A10G 24GB 32 128GB $2.45 Source
Amazon Web Services logo AWS 4x A10G 96GB 48 192GB $4.10 Source
Amazon Web Services logo AWS 4x A10G 384GB 48 192GB $5.68 Source
Amazon Web Services logo AWS 4x A10G 96GB 96 384GB $8.14 Source
Amazon Web Services logo AWS 8x A10G 192GB 192 768GB $16.29 Source

Note: Prices are subject to change and may vary by region and other factors not listed here. For some GPUs, I include links to Shadeform (the sponsor) so you can check if they're available right now. I don’t earn a commission when you click on these links, but their monthly sponsorship helps me keep the site running.

Nvidia A10G specs

FP32 35 TF
TF32 Tensor Core 35 TF
BFLOAT16 Tensor Core 70 TF
FP16 Tensor Core 70 TF
INT8 Tensor Core 140 TOPS
INT4 Tensor Core 280 TOPS
RT Cores 80
Encode / Decode 1 encoder, 2 decoder (+AV1 decode)
GPU Memory 24 GB GDDR6
GPU Memory Bandwidth 600 GB/s
Interconnect PCIe Gen4: 64 GB/s
Form Factor 2-slot FHFL
Max TDP Power 300W
vGPU Software Support NVIDIA RTX™ vWS

Source: official Nvidia A10G datasheet.