Hi, I am using the onnx_tensorrt library to convert onnx model to tensorrt model on runtime. But since it is building the tensorrt engine on runtime it takes more than 4minutes to complete. So i want to use direct tensorrt engine file directly without building on runtime. For this, i have converted…

Hi, The error is caused by the host_inputs parameter. It seems that you don’t allocate the buffer for host_inputs, cuda_inputs, host_outputs, cuda_outputs. Please check the sample code and add it to your source. Thanks.

How to load tensorrt engine directly with building on runtime

Autonomous Machines Jetson & Embedded Systems Jetson Nano

AastaLLL July 19, 2021, 3:59am 3

Hi,

You can find an example to deploy an ONNX model with TensorRT API directly below:

Thanks.

Topic		Replies	Views
Build tensorRT engine for ONNX model Jetson Nano tensorrt	2	1369	October 15, 2021
How to load trained onnx model in jetson nano TensorRT tensorrt , jetson-inference , onnx , nano	3	2116	November 17, 2021
Jetson-Inference predictions differ from e.g. tensorflow predictions Jetson Nano jetson-inference	4	853	November 17, 2021
Tensorrt Inference in Real time Jetson Nano tensorrt , jetson-inference , gstreamer , python	8	1685	April 12, 2023
Run engine trt file on image/video Jetson TX2 tensorrt	8	1464	October 18, 2021
Engine Plan Inference on JetsonTX2 Jetson TX2 tensorrt , python	11	1835	October 18, 2021
Getting error while using tensorRT engine Jetson Nano tensorrt	5	1690	October 15, 2021
Converting FCN8-ResNet18 from Pytorch to TensorRT for inference on Jetson Nano TensorRT tensorrt , jetson-inference , pytorch , python , onnx	3	2229	October 12, 2021
Custom trained model on Jetson Nano Jetson Nano tensorrt	8	1815	October 15, 2021
TensorRT Quick Start Guide Example is not running (JetPack 4.2.2) Jetson AGX Xavier tensorrt , onnx	6	894	January 5, 2022

How to load tensorrt engine directly with building on runtime

Related topics