Trtexec missing in ngc DeepStream container

Accelerated Computing Intelligent Video Analytics DeepStream SDK
1

• Hardware Platform: Jetson NX
• DeepStream Version: 5.1
• JetPack Version: 4.5.1
• TensorRT Version: 7.8
• Issue Type: question
• NGC Container: nvcr.io/nvidia/deepstream-l4t:5.1-21.02-samples

I am trying to convert onnx model to Tensorrt engine but trtexec is not available inside the container.

3

Hi,

The binary is binding by the tensorrt.csv file located at /etc/nvidia-container-runtime/host-files-for-container.d/.
Please remember to launch the container with --runtime nvidia to enable the binding.

For example, we can find the trtexec with the following command:

$ sudo docker run -it --rm --net=host --runtime nvidia  -e DISPLAY=$DISPLAY -w /opt/nvidia/deepstream/deepstream-5.1 -v /tmp/.X11-unix/:/tmp/.X11-unix nvcr.io/nvidia/deepstream-l4t:5.1-21.02-samples
root@Xavier32G:/opt/nvidia/deepstream/deepstream-5.1# ll /usr/src/tensorrt/bin/trtexec
-rwxr-xr-x 1 root root 293672 Jun  6  2020 /usr/src/tensorrt/bin/trtexec*

Thank.s

4

Thank you for the information,

How does this works for the no-jetson containers, for example I am currently testing with nvcr.io/nvidia/deepstream:5.1-21.02-samples and there is no trtexec available on the host system.

5

Hi,

The binary will be added to our future container release.
Thanks.

1 Like
7

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.