Using NVIDIA A100’s Multi-Instance GPU to Run Multiple Workloads in Parallel on a Single GPU (redhat.com) this article shows that when multiple gpu instances are used in palallel to run multiple identical workload, there are small degradations in performance comparing to one gpu instance running a single piece of the same workload. As MIG isolates almost all resources relative to performance, such as cores, memory, cache and even sys pipe physically, why there are still performance degradations in the linear weak scaling test case?
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| ISC20 Featured Demo: Running Multiple Workloads on a Single A100 GPU | 0 | 291 | November 15, 2021 | |
| ISC20 Featured Demo: Boosting Performance and Utilization with Multi-Instance GPU | 0 | 268 | August 21, 2022 | |
| MPI with Multi-Instance GPU (MIG)? | 1 | 972 | July 15, 2020 | |
| Running multiple instances of a sample code on a gpu | 0 | 596 | February 23, 2011 | |
| MIG's multi-Compute Instance (CI) Use case? | 2 | 454 | November 10, 2020 | |
| Performance degradation when running on multiple GPUs | 2 | 810 | November 25, 2015 | |
| About weird performance of multiple GPUs | 0 | 4293 | January 5, 2009 | |
| For MIG on A100 and A30, can different GPU instance communicate? | 1 | 524 | January 2, 2023 | |
| A100 PCIe in Disabled* mode | 3 | 5241 | March 25, 2022 | |
| NVIDIA Multi-instance GPU or vGPU | 2 | 848 | June 14, 2024 |