Originally published at: ISC20 Featured Demo: Boosting Performance and Utilization with Multi-Instance GPU | NVIDIA Technical Blog
The NVIDIA A100 Tensor Core GPU features a new technology – Multi-Instance GPU (MIG), which can guarantee performance for up to seven jobs running concurrently on the same GPU. This unique capability of the A100 GPU offers the right-sized GPU for every job and maximizes data center utilization. This demo runs a natural language processing…