The NC A100 v4 series virtual machine (VM) is a new addition to the Azure GPU family. You can use this series for real-world Azure Applied AI training and batch inference workloads. The NC A100 v4 series is powered by NVIDIA A100 PCIe GPU and third generation AMD EPYC™ 7V13 (Milan) processors. The VMs feature up to 4 NVIDIA A100 PCIe GPUs with 80 GB memory each, up to 96 non-multithreaded AMD EPYC Milan processor cores and 880 GiB of system memory. These VMs are ideal for real-world Applied AI workloads, such as:
GPU-accelerated analytics and databases
Batch inferencing with heavy pre- and post-processing
Autonomy model training
Oil and gas reservoir simulation
Machine learning (ML) development
Video processing
AI/ML web services
Note
We are currently only deploying net new capacity for the latest generation of the NC product line, the NCads_H100_v5-series.
Host specifications
| Part |
Quantity
Count Units |
Specs
SKU ID, Performance Units, etc. |
| Processor |
24 - 96 vCPUs |
AMD EPYC 7V13 (Milan) [x86-64] |
| Memory |
220 - 880 GiB |
|
| Local Storage |
1 Temp Disk
1 - 4 NVMe Disks |
64 - 256 GiB Temp Disk
960 GiB NVMe Disks |
| Remote Storage |
8 - 32 Disks |
30000 - 120000 IOPS
1000 - 4000 MBps |
| Network |
2 - 8 NICs |
20,000 - 80,000 Mbps |
| Accelerators |
1 - 4 GPUs |
Nvidia PCIe A100 GPU (80GB) |
For features supported by this series, see the Feature support section.
Sizes in series
vCPUs (Qty.) and Memory for each size
| Size Name |
vCPUs (Qty.) |
Memory (GB) |
| Standard_NC24ads_A100_v4 |
24 |
220 |
| Standard_NC48ads_A100_v4 |
48 |
440 |
| Standard_NC96ads_A100_v4 |
96 |
880 |
VM Basics resources
Local (temp) storage info for each size
| Size Name |
Max Temp Storage Disks (Qty.) |
Temp Disk Size (GiB) |
| Standard_NC24ads_A100_v4 |
1 |
64 |
| Standard_NC48ads_A100_v4 |
1 |
128 |
| Standard_NC96ads_A100_v4 |
1 |
256 |
Storage resources
Table definitions
- 1Temp disk speed often differs between RR (Random Read) and RW (Random Write) operations. RR operations are typically faster than RW operations. The RW speed is usually slower than the RR speed on series where only the RR speed value is listed.
- Storage capacity is shown in units of GiB or 1024^3 bytes. When you compare disks measured in GB (1000^3 bytes) to disks measured in GiB (1024^3) remember that capacity numbers given in GiB may appear smaller. For example, 1023 GiB = 1098.4 GB.
- Disk throughput is measured in input/output operations per second (IOPS) and MBps where MBps = 10^6 bytes/sec.
- To learn how to get the best storage performance for your VMs, see Virtual machine and disk performance.
Remote (uncached) storage info for each size
| Size Name |
Max Remote Storage Disks (Qty.) |
Uncached Disk IOPS |
Uncached Disk Speed (MBps) |
| Standard_NC24ads_A100_v4 |
8 |
30000 |
1000 |
| Standard_NC48ads_A100_v4 |
16 |
60000 |
2000 |
| Standard_NC96ads_A100_v4 |
32 |
120000 |
4000 |
Storage resources
Table definitions
- 1Some sizes support bursting to temporarily increase disk performance. Burst speeds can be maintained for up to 30 minutes at a time.
- 2Special Storage refers to either Ultra Disk or Premium SSD v2 storage.
- Storage capacity is shown in units of GiB or 1024^3 bytes. When you compare disks measured in GB (1000^3 bytes) to disks measured in GiB (1024^3) remember that capacity numbers given in GiB may appear smaller. For example, 1023 GiB = 1098.4 GB.
- Disk throughput is measured in input/output operations per second (IOPS) and MBps where MBps = 10^6 bytes/sec.
- Data disks can operate in cached or uncached modes. For cached data disk operation, the host cache mode is set to ReadOnly or ReadWrite. For uncached data disk operation, the host cache mode is set to None.
- To learn how to get the best storage performance for your VMs, see Virtual machine and disk performance.
Network interface info for each size
| Size Name |
Max NICs (Qty.) |
Max Bandwidth (Mbps) |
| Standard_NC24ads_A100_v4 |
2 |
20000 |
| Standard_NC48ads_A100_v4 |
4 |
40000 |
| Standard_NC96ads_A100_v4 |
8 |
80000 |
Networking resources
Table definitions
- Expected network bandwidth is the maximum aggregated bandwidth allocated per VM type across all NICs, for all destinations. For more information, see Virtual machine network bandwidth
- Upper limits aren't guaranteed. Limits offer guidance for selecting the right VM type for the intended application. Actual network performance will depend on several factors including network congestion, application loads, and network settings. For information on optimizing network throughput, see Optimize network throughput for Azure virtual machines.
- To achieve the expected network performance on Linux or Windows, you may need to select a specific version or optimize your VM. For more information, see Bandwidth/Throughput testing (NTTTCP).
Accelerator (GPUs, FPGAs, etc.) info for each size
| Size Name |
Accelerators (Qty.) |
Accelerator-Memory (GB) |
| Standard_NC24ads_A100_v4 |
1 |
80 |
| Standard_NC48ads_A100_v4 |
2 |
160 |
| Standard_NC96ads_A100_v4 |
4 |
320 |
Feature support
List of all available sizes: Sizes
Pricing Calculator: Pricing Calculator
Information on Disk Types: Disk Types
Next steps
Take advantage of the latest performance and features available for your workloads by changing the size of a virtual machine.
Utilize Microsoft's in-house designed ARM processors with Azure Cobalt VMs.
Learn how to Monitor Azure virtual machines.