I have a detectnet_v2 model which is developed using TLT. I would like to know about the steps involved in performing inference on python in DGPU, and tensorflow.

How can I perform inference using a TLT output detectnet_v2 .trt model with in custom tensorflow and python

Morganh December 7, 2020, 2:48am 4

Topic		Replies	Views
How to use tlt trained model on Jetson Nano TAO Toolkit tensorrt , jetson-inference	7	2090	October 12, 2021
TensorRT Inference form a .etlt model on Python TAO Toolkit tensorrt	7	1227	November 16, 2021
Tensorrt engine file generated by TLT is not acceptable to inference server TensorRT	3	628	August 16, 2020
How to use TensorRT engine obtained using tlt-convertor TAO Toolkit	4	656	October 12, 2021
Inferencing of LPDNET Model of Nvidia TLT Triton Inference Server - archived	0	596	March 6, 2021
TensorRT Inference Server rejecting valid trt.engine file generated by TLT Triton Inference Server - archived	0	691	August 16, 2020
TensorRT deployment with engine generated from TLT example TensorRT tensorrt	8	776	December 5, 2020
Running nvidia pretrained models in Tensorrt inference TAO Toolkit	14	916	October 6, 2022
Object Detection with TF-TRT TensorRT tensorrt	2	908	September 21, 2021
Examples for porting from Tensorflow to TensorRT4 object detection inference TensorRT	4	2457	April 26, 2018