Cannot run tao-converter on DS6.1

Please provide the following information when requesting support.

• Hardware (T4/V100/Xavier/Nano/etc) Xavier - Jetpack 5.0.1DP - DS 6.1
• Network Type (Detectnet_v2/Faster_rcnn/Yolo_v4/LPRnet/Mask_rcnn/Classification/etc) TrafficamNet
• How to reproduce the issue ? (This is for errors. Please share the command line and the detailed log here.)

Cannot convert TrafficamNet to tensorrt.
Logs

./tao-converter: error while loading shared libraries: libnvinfer.so.7: cannot open shared object file: No such file or directory

Step 1: Download tao-converter from nvidia ngc version v3.22.5.trt8.4._aarch64
Step 2: Download TrafficamNet from nvidia ngc

Step3: Fix tensorrt version in calibration file to TRT-8401-EntropyCalibration2
Step 4: Convert

./tao-converter resnet18_trafficcamnet_pruned.etlt -k tlt_encode -d 3,544,960 -o output_cov/Sigmoid,output_bbox/BiasAdd -c trafficcamnet_int8.txt -e resnet34_int8_jetson.engine -m 8 -t int8


@Morganh Can you please take a look?

Please share the result of $dpkg -l |grep cuda

ii  cuda-cccl-11-4                             11.4.167-1                          arm64        CUDA CCCL
ii  cuda-command-line-tools-11-4               11.4.14-1                           arm64        CUDA command-line tools
ii  cuda-compiler-11-4                         11.4.14-1                           arm64        CUDA compiler
ii  cuda-cudart-11-4                           11.4.167-1                          arm64        CUDA Runtime native Libraries
ii  cuda-cudart-dev-11-4                       11.4.167-1                          arm64        CUDA Runtime native dev links, headers
ii  cuda-cuobjdump-11-4                        11.4.167-1                          arm64        CUDA cuobjdump
ii  cuda-cupti-11-4                            11.4.167-1                          arm64        CUDA profiling tools runtime libs.
ii  cuda-cupti-dev-11-4                        11.4.167-1                          arm64        CUDA profiling tools interface.
ii  cuda-cuxxfilt-11-4                         11.4.167-1                          arm64        CUDA cuxxfilt
ii  cuda-documentation-11-4                    11.4.167-1                          arm64        CUDA documentation
ii  cuda-driver-dev-11-4                       11.4.167-1                          arm64        CUDA Driver native dev stub library
ii  cuda-gdb-11-4                              11.4.167-1                          arm64        CUDA-GDB
ii  cuda-libraries-11-4                        11.4.14-1                           arm64        CUDA Libraries 11.4 meta-package
ii  cuda-libraries-dev-11-4                    11.4.14-1                           arm64        CUDA Libraries 11.4 development meta-package
ii  cuda-nvcc-11-4                             11.4.166-1                          arm64        CUDA nvcc
ii  cuda-nvdisasm-11-4                         11.4.167-1                          arm64        CUDA disassembler
ii  cuda-nvml-dev-11-4                         11.4.167-1                          arm64        NVML native dev links, headers
ii  cuda-nvprof-11-4                           11.4.166-1                          arm64        CUDA Profiler tools
ii  cuda-nvprune-11-4                          11.4.167-1                          arm64        CUDA nvprune
ii  cuda-nvrtc-11-4                            11.4.166-1                          arm64        NVRTC native runtime libraries
ii  cuda-nvrtc-dev-11-4                        11.4.166-1                          arm64        NVRTC native dev links, headers
ii  cuda-nvtx-11-4                             11.4.166-1                          arm64        NVIDIA Tools Extension
ii  cuda-samples-11-4                          11.4.166-1                          arm64        CUDA example applications
ii  cuda-sanitizer-11-4                        11.4.166-1                          arm64        CUDA Sanitizer
ii  cuda-toolkit-11-4                          11.4.14-1                           arm64        CUDA Toolkit 11.4 meta-package
ii  cuda-toolkit-11-4-config-common            11.4.167-1                          all          Common config package for CUDA Toolkit 11.4.
ii  cuda-toolkit-11-config-common              11.4.167-1                          all          Common config package for CUDA Toolkit 11.
ii  cuda-toolkit-config-common                 11.4.167-1                          all          Common config package for CUDA Toolkit.
ii  cuda-tools-11-4                            11.4.14-1                           arm64        CUDA Tools meta-package
ii  cuda-visual-tools-11-4                     11.4.14-1                           arm64        CUDA visual tools
ii  graphsurgeon-tf                            8.4.0-1+cuda11.4                    arm64        GraphSurgeon for TensorRT package
ii  libcudnn8                                  8.3.2.49-1+cuda11.4                 arm64        cuDNN runtime libraries
ii  libcudnn8-dev                              8.3.2.49-1+cuda11.4                 arm64        cuDNN development libraries and headers
ii  libcudnn8-samples                          8.3.2.49-1+cuda11.4                 arm64        cuDNN samples
ii  libnvinfer-bin                             8.4.0-1+cuda11.4                    arm64        TensorRT binaries
ii  libnvinfer-dev                             8.4.0-1+cuda11.4                    arm64        TensorRT development libraries and headers
ii  libnvinfer-doc                             8.4.0-1+cuda11.4                    all          TensorRT documentation
ii  libnvinfer-plugin-dev                      8.4.0-1+cuda11.4                    arm64        TensorRT plugin libraries
ii  libnvinfer-plugin8                         8.4.0-1+cuda11.4                    arm64        TensorRT plugin libraries
ii  libnvinfer-samples                         8.4.0-1+cuda11.4                    all          TensorRT samples
ii  libnvinfer8                                8.4.0-1+cuda11.4                    arm64        TensorRT runtime libraries
ii  libnvonnxparsers-dev                       8.4.0-1+cuda11.4                    arm64        TensorRT ONNX libraries
ii  libnvonnxparsers8                          8.4.0-1+cuda11.4                    arm64        TensorRT ONNX libraries
ii  libnvparsers-dev                           8.4.0-1+cuda11.4                    arm64        TensorRT parsers libraries
ii  libnvparsers8                              8.4.0-1+cuda11.4                    arm64        TensorRT parsers libraries
ii  nvidia-l4t-cuda                            34.1.1-20220516211757               arm64        NVIDIA CUDA Package
ii  python3-libnvinfer                         8.4.0-1+cuda11.4                    arm64        Python 3 bindings for TensorRT
ii  python3-libnvinfer-dev                     8.4.0-1+cuda11.4                    arm64        Python 3 development package for TensorRT
ii  tensorrt                                   8.4.0.11-1+cuda11.4                 arm64        Meta package of TensorRT
ii  uff-converter-tf                           8.4.0-1+cuda11.4                    arm64        UFF converter for TensorRT package

Can you run below successfully?
$ ./tao-converter -h

No, I think tao-converter version in ngc is wrong

./tao-converter -h
./tao-converter: error while loading shared libraries: libnvinfer.so.7: cannot open shared object file: No such file or directory

Please try below one to check if it works.
image

I cannot reproduce the error you mentioned.
I download v3.22.5.trt8.4_aarch64

Please check again for it.
$ md5sum tao-converter
fbc94d5fbb99965650d7c5dff7bd7ed7 tao-converter

My bad. I extract the wrong file. So sorry about that.

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.