Tlt-converter fails when converting yolov4_resnet18 on Xavier AGX

Accelerated Computing Intelligent Video Analytics TAO Toolkit
1

Hi!
I’ve been following the guide on training and deploying object detection models with the tlt jupyter notebook examples. I’m following the yolo_v4 resnet18 example.
The training and export work fine, but when I try converting the model to TensorRT on the Xavier AGX it fails:

$ ./tlt-converter -k KEY -d 3,640,640 -o BatchedNMS -c cal.bin -t int8 -i nchw yolov4_resnet18_epoch_080.etlt
[ERROR] UffParser: Validator error: FirstDimTile_2: Unsupported operation _BatchTilePlugin_TRT
[ERROR] Failed to parse the model, please check the encoding key to make sure it's correct
[ERROR] Network must have at least one output
[ERROR] Network validation failed.
[ERROR] Unable to create engine
Segmentation fault (core dumped)

The Xavier board is updated to jetson 4.5 using the SDK manager and I’m using the appropriate conversion script for jetson 4.5.
The conversion works if using the PC that did the training.

Thank you in advance.

2

Did find a workaround by downloading libnvinfer_plugin.so.7.1.3 from deepstream_tao_apps/TRT-OSS/Jetson/TRT7.1 at master · NVIDIA-AI-IOT/deepstream_tao_apps · GitHub
and moving it:

$ wget https://github.com/NVIDIA-AI-IOT/deepstream_tlt_apps/raw/master/TRT-OSS/Jetson/TRT7.1/libnvinfer_plugin.so.7.1.3
$ sudo mv libnvinfer_plugin.so.7.1.3 /usr/lib/aarch64-linux-gnu/
$ sudo ln -s /usr/lib/aarch64-linux-gnu/ libnvinfer_plugin.so.7.1.3  /usr/lib/aarch64-linux-gnu/libnvinfer_plugin.so.7
$ sudo ln -s /usr/lib/aarch64-linux-gnu/ libnvinfer_plugin.so.7.1.3  /usr/lib/aarch64-linux-gnu/libnvinfer_plugin.so

Though not sure if that is the correct approach?

3

For YOLOv3, we need the batchTilePlugin and batchedNMSPlugin plugins from the TensorRT OSS build. See YOLOv3 — Transfer Learning Toolkit 3.0 documentation

For the step, please strictly follow deepstream_tao_apps/TRT-OSS/Jetson/TRT7.1 at master · NVIDIA-AI-IOT/deepstream_tao_apps · GitHub
There is one reference I ever posted in a topic.
Failling in building sample from TLT-DEEPSTREAM - #15 by Morganh