Exported model can't move to jetson tx2

[Morganh]

It is not related to the trt version of the docker. Because you will run inference in TX2. So, you need to copy etlt model to TX2, and then

1. generate trt engine in TX2 via tao-converter or
2. let the deepstream generate trt engine.

We just build trt oss plugin in order to replace the libnvinfer_plugin.so.
Please try to run GitHub - NVIDIA-AI-IOT/deepstream_tao_apps: Sample apps to demonstrate how to deploy models trained with TAO on DeepStream with the official demo etlt models.

Refer to below topic, I rebuild trt oss plugin and replace it in NX.

Error in Yolov4 engine conversion,

Can you rebuild the libnvinfer_plugin.so again ? I can generate the trt engine successfully in NX with this official yolo_v4 etlt model. Step: $ git clone -b 21.03 https://github.com/nvidia/TensorRT $ cd TensorRT/ $ git submodule update --init --recursive $ export TRT_SOURCE=pwd $ cd $TRT_SOURCE $ mkdir -p build && cd build $ /usr/local/bin/cmake … -DGPU_ARCHS=72 -DTRT_LIB_DIR=/usr/lib/aarch64-linux-gnu/ -DCMAKE_C_COMPILER=/usr/bin/gcc -DTRT_BIN_DIR=pwd/out $ ll /usr/lib/aarch64…

More reference, see YOLOv4 - NVIDIA Docs