TF-TRT Error on Jetson Nano

AI & Data Science Deep Learning (Training & Inference) TensorRT
,
1

Description

A clear and concise description of the bug or issue.

Hello,

I am trying to convert my Tensorflow Frozen graph model (.pb) to TensorRT format.

My tensorflow version is: tensorflow 1.15.5+nv21.3

I share my convert script below:

from tensorflow.python.compiler.tensorrt import trt_convert as trt

converter=trt.TrtGraphConverter(input_graph_def=“frozen_inference_graph.pb”, nodes_blacklist=[‘logits’,‘classes’])
frozen_graph=converter.convert()

When I run this script, I get an error. Here is my error

2021-08-25 20:48:10.964086: W tensorflow/stream_executor/platform/default/dso_loader.cc:60] Could not load dynamic library ‘libnvinfer.so.7’; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory
2021-08-25 20:48:10.964404: W tensorflow/stream_executor/platform/default/dso_loader.cc:60] Could not load dynamic library ‘libnvinfer_plugin.so.7’; dlerror: libnvinfer_plugin.so.7: cannot open shared object file: No such file or directory
2021-08-25 20:48:10.964447: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:30] Cannot dlopen some TensorRT libraries. If you would like to use Nvidia GPU with TensorRT, please make sure the missing libraries mentioned above are installed properly.
2021-08-25 20:48:10.967269: W tensorflow/stream_executor/platform/default/dso_loader.cc:60] Could not load dynamic library ‘libnvinfer.so.7’; dlerror: libnvinfer.so.7: cannot open shared object file: No such file or directory
2021-08-25 20:48:10.967326: F tensorflow/compiler/tf2tensorrt/stub/nvinfer_stub.cc:49] getInferLibVersion symbol not found.
Aborted (core dumped)

How can I convert my .pb tensorflow model to TensorRT model?
Tensorflow model is trained deeplab segmentation model.

My jetson nano is Jetpack 4.6, TensorRT version is 8.0.1 and cuda10.2.

Thanks

Environment

TensorRT Version: 8.0.1
GPU Type: 128-core Maxwell
Nvidia Driver Version:
CUDA Version: 10.2
CUDNN Version: cuDNN 8.2.1
Operating System + Version: Jetpack 4.6
Python Version (if applicable): 3.6
TensorFlow Version (if applicable): 1.15
PyTorch Version (if applicable):
Baremetal or Container (if container which image + tag):

Relevant Files

Please attach or include links to any models, data, files, or scripts necessary to reproduce your issue. (Github repo, Google Drive, Dropbox, etc.)

Steps To Reproduce

Please include:

  • Exact steps/commands to build your repro
  • Exact steps/commands to run your repro
  • Full traceback of errors encountered
2

Hi,
This looks like a Jetson issue. Please refer to the below samlples in case useful.

For any further assistance, we recommend you to raise it to the respective platform from the below link

Thanks!

5

Hi @skilic
Please refer to below topic as well in case it helps:

Thanks