Nsight system 2023.1.2 Error when profilining

Developer Tools Nsight Systems Profiling x86 Windows Targets
1

My system with Nvidia 3080 Ti Laptop always stops when profilining on Nsight System 2023.1.2.
May I know what error message from the report means from the picture below?

image
image1311Ă—800 54.4 KB

Tried to reinstall Windows and update and downgrade Nvidia drivers but they all did not solve the issue.

[Hardware]
Graphics Card: NVIDIA GeForce RTX 3080 Ti Laptop
CPU: i9-12900H
Memory: 32GB
Hard Drive: 1TB SSD (SN810 with latest firmware)

[Software]
OS: Windows 11 Pro 64-bit (10.0, Build 22621)
GPU Driver for NVIDIA: 31.0.15.3114 / WDDM 3.1
CUDA Driver: 11.6 + 12.1

[Nsight]
NVIDIA Nsight Systems: 2021.5.2
NVIDIA Nsight Systems: 2023.1.2
NVIDIA Nsight Systems: 2023.2.1
NVIDIA Nsight Compute: 2023.1.1
NVIDIA Nsight Graphics: 2023.2.0
NVIDIA Nsight Visual Studio Edition: 2023.1.1.23089
NVIDIA CUDA Nsight NVTX: 11.6

2

There is a known issue with the underlying CUPTI trace library in CTK 12.1 that can cause this issue.

I’m not sure if the issue is fixed in 2023.2 (the most recent public release on the website). You may want to try falling back to the 2021 version you already have installed alongside.

I know that the fix will be incorporated for sure in the 2023.3 release, currently slated for mid to late August.

1 Like
4

Appreicate the information.
It seems my issue is very similar to the issue below, so may I know if there is any chance to have the 2023.2.3 of Windows version?

5

@youngmin_lee - Does your app use CUPTI in any form already? The error CUPTI_ERROR_MULTIPE_SUBSCRIBERS_NOT_SUPPORTED seems to suggest that something other than nsys is already using CUPTI for that app. Are you able to profile a simple CUDA toolkit sample with nsys?

may I know if there is any chance to have the 2023.2.3 of Windows version

If you download the CUDA toolkit 12.2, then you will get the Nsight Systems 2023.2.3 version with it.

6

@youngmin_lee the Windows version 2023.2.1 is on the web and is the same code just built for a different purpose.

7

@youngmin_lee - we followed up with the CUPTI team internally and they have confirmed that it is a bug in CUPTI. From CUPTI 11.8 onwards, the support for “Geforce RTX 3080 Ti laptop GPU” was broken. They are working on a fix which will be made available in a future release of nsys. In the meantime, you could go back to the CUDA 11.7 driver (version 515) and use the latest nsys version, if needed.

Sorry for the inconvenience so far. I understand it has been frustrating.

8

Hi Skottapalli and team,

Understood. The only GPU I have been actually struggling with is 3080 TI Laptop.
Looking forward to updating the fix sooner. In the meamtime, will revert to CUDA 11.7 driver and use the latest nsys version as suggsted.
Thank you all in this treahd for supporting this issue. Appreciate it as always!

9

We have a new version of nsys that contains the fix from CUPTI Nsight Systems | NVIDIA Developer
Please try it out and let us know if you are still running into problems.