import tensorrt as trt import os trt_logger = trt.Logger(trt.Logger.VERBOSE) trt_file_path = “./yolox_tiny.trt” if not os.path.exists(trt_file_path): raise FileNotFoundError(f"The TensorRT file does not exist: {trt_file_path}") try: with open(trt_file_path, “rb”) as f: engine_data = f.read() …

There is no update from you for a period, assuming this is not an issue any more. Hence we are closing this topic. If need further support, please open a new one. Thanks Hi, Does your app work after registering the plugin? Thanks.

Hi, Could you share the TensorRT verbose log with us as well? It should output on the console since you already enabled it in your app. Thanks.

Thank you for your response. The log is as follows. I appreciate your cooperation. [07/09/2024-16:41:05] [TRT] [I] Loaded engine size: 11 MiB [07/09/2024-16:41:05] [TRT] [W] Using an engine plan file across different models of devices is not recommended and is likely to affect performance or even …

Hi, Please try below comment: [image] Error: Cannot deserialize plugin since corresponding IPluginCreator not found in Plugin Registry with Yolov4 TensorRT engine TensorRT Hi @arivarasan.e , Are you registering the plugins before deserializing TRT engine in python? May…

Hello. Thank you for your response. I did not register the plugin. Thanks.

Troubleshooting TensorRT Engine Deserialization Issue: Null Engine

Robotics & Edge Computing Jetson Systems Jetson Orin Nano

AastaLLL July 10, 2024, 7:34am 5

Hi,

Please try below comment:

Thanks.

Topic		Replies	Views
Python TensorRT loaded engine failed Jetson AGX Orin tensorrt	5	642	April 25, 2023
Troubleshooting TensorRT Engine Deserialization Issue: Null Engine Jetson Orin Nano cudnn	2	152	July 23, 2024
How to load and deserialize the .engine file? TensorRT	3	4928	January 30, 2020
To deserialize an engine without a factory, please use IPluginV2 instead TensorRT tensorrt	5	1160	March 29, 2021
Runtime.deserialize_cuda_engine return a NoneType, how to fix ti? TensorRT tensorrt	10	2648	July 15, 2022
CUDA Error in TensorRT deserializeCudaEngine() TensorRT tensorrt , cuda , linux	4	3521	June 10, 2021
How to load and deserialize the .engine file? Jetson TX2	1	1472	August 1, 2019
Trt_yolo_app TensorRT	3	1694	October 30, 2020
Python engine inference API bug TensorRT	1	566	February 13, 2023
TensorRT C++ engine deserealization failed. Windows 10 TensorRT	3	693	June 28, 2022

Troubleshooting TensorRT Engine Deserialization Issue: Null Engine

Related topics