NSYS profiling does not work with MIG on GH200

Developer Tools Nsight Systems Profiling Linux Targets
1

Hello,

nsys fails with following error when MIG is enabled:

$ CUDA_VISIBLE_DEVICES=MIG-b9959c1f-a931-5d21-83c9-b2602d80579f nsys  profile --output=nsys --backtrace=fp --trace=none ~/sources/cuda-samples/build/Samples/0_Introduction/matrixMul/matrixMul 
Unexpected TH500 socket configuration

MIG was enabled with following commands:

$ sudo nvidia-smi -i 0 -mig 1
$ sudo nvidia-smi mig -cgi 1g.12gb,1g.12gb,1g.12gb,1g.12gb,1g.12gb,1g.12gb,1g.12gb -C

Software is Ubuntu 24.04. Kernel is 6.8.0-1041-nvidia-64k, driver version 580.95.05, CUDA Version 13.0.

Hardware is Grace Hopper 200, 480 GB.

Looking forward to any advice.

2

What version of Nsys are you using?

@skottapalli can you help here?

3

This bug was fixed in nsys version 2025.4.1. Could you please try the latest version from Nsight Systems - Get Started | NVIDIA Developer

4

Indeed, I was using version 2025.3.2.474-253236389321v0 downloaded from the apt repository together with CUDA. I will try the new version and report back. Thanks!

1 Like