There is error happening when i used dlprof to profile tensorrt sample code

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

When i run dlprof to profile tensort sample sample_onnx_mnist, there is error happening as below:
Exported successfully to
/tmp/nsys-report-5ba1-d87b-4be6-92c6.sqlite
Report file moved to “/usr/src/tensorrt/bin/./output-mnist/nsys_profile.qdstrm”
Report file moved to “/usr/src/tensorrt/bin/./output-mnist/nsys_profile.qdrep”
Report file moved to “/usr/src/tensorrt/bin/./output-mnist/nsys_profile.sqlite”

[DLProf-11:34:23] DLprof completed system call successfully
[DLProf-11:34:23] Initializing Nsight Systems database
[DLProf-11:34:23] Reading System Information from Nsight Systems database
[DLProf-11:34:23] Reading Domains from Nsight Systems database
[DLProf-11:34:23] Error Occurred:
[DLProf-11:34:23] Nsight Systems did not detect any NVTX traces. Please check your script and try again.

cmd line:
dlprof --mode=tensorrt --output_path ./output-mnist/ ./sample_onnx_mnist

But the sample char-rnn can be profiled using dlprof, so my question is whether need user to annotate source code manually using NVTX for tensorrt?

2

Hi,
Request you to share the ONNX model and the script if not shared already so that we can assist you better.
Alongside you can try few things:

  1. validating your model with the below snippet

check_model.py

import sys
import onnx
filename = yourONNXmodel
model = onnx.load(filename)
onnx.checker.check_model(model).
2) Try running your model with trtexec command.

In case you are still facing issue, request you to share the trtexec “”–verbose"" log for further debugging
Thanks!