GPU optimized virtual machine sizes

  • Article

Applies to: ✔️ Linux VMs ✔️ Windows VMs ✔️ Flexible scale sets ✔️ Uniform scale sets

GPU optimized VM sizes are specialized virtual machines available with single, multiple, or fractional GPUs. These sizes are designed for compute-intensive, graphics-intensive, and visualization workloads. This article provides information about the number and type of GPUs, vCPUs, data disks, and NICs. Storage throughput and network bandwidth are also included for each size in this grouping.

  • The NCv3-series and NC T4_v3-series sizes are optimized for compute-intensive GPU-accelerated applications. Some examples are CUDA and OpenCL-based applications and simulations, AI, and Deep Learning. The NC T4 v3-series is focused on inference workloads featuring NVIDIA's Tesla T4 GPU and AMD EPYC2 Rome processor. The NCv3-series is focused on high-performance computing and AI workloads featuring NVIDIA’s Tesla V100 GPU.

  • NVv4-series VM sizes optimized and designed for VDI and remote visualization. With partitioned GPUs, NVv4 offers the right size for workloads requiring smaller GPU resources. These VMs are backed by the AMD Radeon Instinct MI25 GPU. NVv4 VMs currently support only Windows guest operating system.

Supported operating systems and drivers

To take advantage of the GPU capabilities of Azure N-series VMs, NVIDIA drivers must be installed.

  • For VMs backed by NVIDIA GPUs

You may install NVIDIA GPU drivers manually. See Install NVIDIA GPU drivers on N-series VMs running Windows or Install NVIDIA GPU drivers on N-series VMs running Linux for supported operating systems, drivers, installation, and verification steps.

Deployment considerations

  • For availability of N-series VMs, see Products available by region.

  • N-series VMs can only be deployed in the Resource Manager deployment model.

  • N-series VMs differ in the type of Azure Storage they support for their disks. NCv3 VMs support VM disks that are backed by Standard Disk Storage and Premium Disk Storage (SSD).

  • If you want to deploy more than a few N-series VMs, consider a Standard Pay-in-Advance Offer subscription or other purchase options. If you're using an Azure trial subscription, you can use only a limited number of Azure compute cores.

  • You might need to increase the cores quota (per region) in your Azure subscription, and increase the separate quota for NCv3 cores. To request a quota increase, open an online customer support request at no charge. Default limits may vary depending on your subscription category.

Other sizes

Next steps

Learn more about how Azure compute units (ACU) can help you compare compute performance across Azure SKUs.