GPU memory Available vCPUs Available memory Tensor cores CUDA cores NVIDIA® Tesla® K80 Kepler 2014 8 GPUs 96 GB GDDR5 1 - 64 vCPUs 1 - 208 GB --- 2,496 NVIDIA® Tesla® P100 Pascal 2016 4 GPUs 64 GB HBM2 1 - 96 vCPUs 1 - 624 GB --- 3,584 NVIDIA® Tesla® P4 Pascal 2016 4 GPUs 32 GB GDDR5 1 - 96 vCPUs 1 - 624 GB --- 2,560 NVIDIA® Tesla® V100 Volta 2017 8 GPUs 128 GB HBM2 1 - 96 vCPUs 1 - 624 GB 640 5,120 NVIDIA® Tesla® T4 Turing 2018 4 GPUs 64 GB GDDR6 1 - 96 vCPUs 1 - 624 GB 320 2,560 NVIDIA® Tesla® A100 Ampere 2020 16 GPUs 640 GB HBM2 Up to 96 vCPUs* Up to 1.3 TB 432 6,912 *The A2 family uses Cascade Lake CPUs