I am trying to run a resnet18 classification model .trt engine file using a stand alone python script. When I load and run the model, the performance is quite different from the .tlt based tlt-infer. I have optimized and generated .trt engines for fp32, fp16 and int8 precisions, but for all these tr…

Sampes to run a tlt based resnet18 classification model tensorrt engine file

Morganh February 9, 2021, 1:52pm 2

1 Like

Topic		Replies	Views
Very bad result on tlt mobilenetv2 tensorrt TAO Toolkit	2	674	November 2, 2021
Inferring resnet18 classification etlt model with python TAO Toolkit	45	4437	October 12, 2021
Very bad result on tlt mobilenetv2 tensorrt TensorRT	5	1146	January 5, 2022
Getting different result on tlt vs fp16/fp32 engine file TAO Toolkit	3	547	June 7, 2022
Performance drop when performing inference with a .trt engine on a python script TensorRT tensorrt	3	550	February 18, 2022
Run inference using TensorRT using .engine file of .trt file Frameworks (archived) tensorflow	1	624	December 4, 2020
Resnet18 trained with TAO has low accuracy on some classes after exporting to TensorRT and serving with Triton TAO Toolkit tensorrt , python , inference-server-triton , grpc , tao	2	1167	June 9, 2022
How preform inference retinanet using a TLT export .engine file by python TAO Toolkit tensorrt	4	950	October 12, 2021
Run inference using TensorRT using .engine file of .trt file TensorRT	0	343	April 2, 2020
Run .egine models of TLT with TensorRT in general TAO Toolkit	2	582	October 12, 2021