I am getting this error: torch._dynamo.exc.InternalTorchDynamoError: ModuleNotFoundError: No module named ‘nsys_nvtx_annotations’ I am simply trying to prifle a neural network training script which has torch.compile in it. Please help!

@rishabhranjan0207 thank you for reporting this! Currently, the option --pytorch=functions-trace is not compatible with torch.compile. We will consider adding support for that. You can workaround this by removing the unsupported annotations from /target-linux-x64/PythonFunctionsTrace/pytorch.json, which are torch.nn.modules.*.forward and torch.nn.functional.* (of course, those annotations will be missing). Note that --pytorch=autograd-nvtx and --pytorch=autograd-shapes-nvtx is expected to work fine.

@rishabhranjan0207 can you tell me what version of Nsight Systems you were using and the OS?

NVIDIA Nsight Systems version 2025.2.1.130-252135690618v0 OS: Ubuntu 22.04.4 LTS

Nsys profile --pytorch fails under torch compile

Developer Tools Nsight Systems Profiling Linux Targets

hwilper May 8, 2025, 6:04pm 5

@Guy_Sz were there pytorch trace improvements in 2025.3?

Topic		Replies	Views
No cuDNN info in nsys traces Profiling Linux Targets nsight , pytorch	2	1575	May 16, 2022
Nsys profile failed when using pytorch cudagraph Profiling Linux Targets pytorch	3	710	June 12, 2024
Nv-nsight-cu-cli Does not work in NGC Pytorch container 20.03 Nsight Compute pytorch	1	622	April 21, 2020
How to profile .py file using nsight compute? Profiling Linux Targets	1	1753	January 11, 2023
Nvprof python.exe pytorch code Visual Profiler and nvprof	2	1538	September 9, 2023
Error in sampling pytroch profile with nsys and dlprof Profiling Linux Targets nsight	3	2195	October 7, 2023
Profling a simple deep learning code : no python backtrace + cannot use cudnn trace Profiling x86 Windows Targets cudnn	18	1688	November 29, 2023
Error when using torch.compile on Jetson Orin NX Jetson AGX Orin pytorch	6	1537	June 27, 2024
Cannot connect to process in nsight compute Nsight Compute deep-learning-profiler	4	1109	April 29, 2024
NSIGHT Systems and NSIGHT Compute Nsight Compute	6	638	March 3, 2025

Nsys profile --pytorch fails under torch compile

Related topics