Profile backward pass of DNN

vinayakah · April 25, 2023, 5:41am

Hi, I wanted to profile the per layer execution times for backward pass of a DNN. Existing profilers like pytorch profiler give operator-level stats. But, I wanted a layerwise time. So, I wanted to know if Nvidia has a profiler to do this ?
Does DLPROF : DLProf User Guide - NVIDIA Docs help with this ?

Device : Orin Jetpack v5.0.1
Using : Pytorch v2.0.0

vinayakah · April 27, 2023, 9:23am

@dusty_nv Would you be able to help please?

AakankshaS · April 29, 2023, 4:50pm

Hi @vinayakah ,
Apologies for the delay.
Let me check on this, will get back to you shortly.

thanks

Topic		Replies	Views
Profiling and Optimizing Deep Neural Networks with DLProf and PyProf Technical Blog	13	1665	August 11, 2021
Calling nvprof from a pythoon code cuDNN	0	523	January 26, 2019
TensorRT 5 - Python profiler TensorRT	3	2745	October 27, 2018
Performance of Neural Network on Jetson Jetson TX2	5	680	July 9, 2019
Inference on NN onnx model by using NVIDIA profiler Visual Profiler and nvprof	0	641	July 23, 2023
nvprof seems to make inference slower, no tensor cores being used Jetson AGX Xavier	3	1075	January 7, 2020
DLProf Pytorch NVTX annotations overhead Profiling Linux Targets nsight , pytorch	0	1119	September 9, 2021
No GPU associated to the given UUID Profiling Linux Targets	6	842	July 18, 2024
Profiling NCCL Deep Learning (Training & Inference)	0	580	October 22, 2018
Dlprof with pytorch's distributed dataparallel Profiling Linux Targets nsight , deep-learning-profiler , deep-learning	2	783	September 28, 2022

Profile backward pass of DNN

Related topics