Nvidia A16
Compare prices for Nvidia A16 across cloud providers.
Pricing
Provider | GPUs | VRAM | vCPUs | RAM | Price/h | |
---|---|---|---|---|---|---|
![]() |
1x A16 | 16GB | 6 | 64GB | $0.51 | Launch |
![]() |
2x A16 | 96GB | 12 | 128GB | $1.02 | Launch |
![]() |
4x A16 | 192GB | 24 | 256GB | $2.05 | Launch |
![]() |
8x A16 | 384GB | 48 | 486GB | $4.09 | Reserve |
![]() |
16x A16 | 768GB | 96 | 960GB | $9.19 | Reserve |
Note: Prices are subject to change, and may vary by region and other factors not listed here. I included links to launch GPUs using Shadeform (our sponsor) so you can see if they're available right now. There's no fees to use their service and I don't get a commission when you use these links.
Specs
GPU Architecture | NVIDIA Ampere architecture |
GPU Memory | 4x 16 GB GDDR6 |
Memory Bandwidth | 4x 200 GB/s |
Error-Correcting Code (ECC) | Yes |
NVIDIA Ampere architecture-based CUDA Cores | 4x 1280 |
NVIDIA Third-Generation Tensor Cores | 4x 40 |
NVIDIA Second-Generation RT Cores | 4x 10 |
FP32 | TF32 | TF32' (TFLOPS) | 4x 4.5, 4x 9, 4x 18 |
FP16 | FP16' (TFLOPS) | 4x 17.9, 4x 35.9 |
INT8 | INT8' (TOPS) | 4x 35.9, 4x 71.8 |
System Interface | PCIe Gen4 (x16) |
Max Power Consumption | 250W |
Thermal Solution | Passive |
Form Factor | Full height, full length (FHFL) Dual Slot |
Power Connector | 8-pin CPU |
Encode/Decode Engines | 4 NVENC, 8 NVDEC (includes AV1 decode) |
Secure and Measured Boot with Hardware Root of Trust for GPU | Yes (optional) |
vGPU Software Support | NVIDIA Virtual PC (vPC), NVIDIA Virtual Applications (vApps), NVIDIA RTX Virtual Workstation (vWS), NVIDIA AI Enterprise, NVIDIA Virtual Compute Server (vCS) |
Graphics APIs | DirectX 12.07, Shader Model 5.17, OpenGL 4.68, Vulkan 1.18 |
Compute APIs | CUDA, DirectCompute, OpenCL™, OpenACC® |
MIG Support | No |
You can find the official datasheet here.
Looking for alternatives? Compare Nvidia A16 against other GPUs.