Hi, I am using the onnx_tensorrt library to convert onnx model to tensorrt model on runtime. But since it is building the tensorrt engine on runtime it takes more than 4minutes to complete. So i want to use direct tensorrt engine file directly without building on runtime. For this, i have converted…

Hi, The error is caused by the host_inputs parameter. It seems that you don’t allocate the buffer for host_inputs, cuda_inputs, host_outputs, cuda_outputs. Please check the sample code and add it to your source. Thanks.

How to load tensorrt engine directly with building on runtime

Robotics & Edge Computing Jetson & Embedded Systems Jetson Nano

AastaLLL July 19, 2021, 3:59am 3

Hi,

You can find an example to deploy an ONNX model with TensorRT API directly below:

Thanks.

Topic		Replies	Views
Build tensorRT engine for ONNX model Jetson Nano tensorrt	2	1458	October 15, 2021
Run engine trt file on image/video Jetson TX2 tensorrt	8	1660	October 18, 2021
Engine Plan Inference on JetsonTX2 Jetson TX2 tensorrt , python	11	1968	October 18, 2021
How to infer using tensorRT on jetson nano? Jetson Nano tensorrt , deep-learning	4	1115	October 15, 2021
Tensorrt inference in real time TensorRT tensorrt , python	1	658	March 13, 2023
TensorRT deployment with engine generated from TLT example TensorRT tensorrt	8	859	December 5, 2020
Two inputs in TensorRT engine using python TensorRT tensorrt , jetson-inference , python	2	1122	November 4, 2023
Converting yolov4 onnx model to TensorRT for multi batch input TensorRT cudnn	3	739	January 31, 2024
Run onnx model on jetson nano Jetson Nano pytorch , onnx	2	8556	October 15, 2021
Onnx to trt engine DeepStream SDK	5	950	October 12, 2021

How to load tensorrt engine directly with building on runtime

Related topics