Tensorflow with TensorRT on Jetson TX2

Hello All,

I am new to jetson platform.
I followed this documentation https://docs.nvidia.com/deeplearning/frameworks/install-tf-jetson-platform/index.html to install tensorflow on jetson. Will this install tensorflow with tensorRT support.

(or)

Should I follow this documentation https://github.com/NVIDIA-AI-IOT/tf_trt_models to install tensorflow with tensorRT

Thanks…

Hi,

YES. The release includes TensorRT support.

Please noticed that there are two possible way to execute TensorRT.

1.TFTRT:
Execute TensorRT within TensorFlow frameworks.
The process is pretty easy but there are some performance overhead from TensorFlow.
https://github.com/NVIDIA-AI-IOT/tf_trt_models

2. Pure Tensorrt:
It can maximize the inference performance on Jetson but it’s more complicated to use.
https://github.com/NVIDIA-AI-IOT/tf_to_trt_image_classification

Thanks.