ISC20 Featured Demo: Running Multiple Workloads on a Single A100 GPU

Originally published at: ISC20 Featured Demo: Running Multiple Workloads on a Single A100 GPU | NVIDIA Developer Blog

The NVIDIA A100 Tensor Core GPU includes a groundbreaking feature called Multi-Instance GPU (MIG), which partitions the GPU into as many as seven instances, each with dedicated compute, memory, and bandwidth.  This allows multiple users to run their workloads on the same GPU, maximizing per-GPU utilization and user productivity.  This demo runs an HPC simulation,…