Hi, I want to run two TensorRT Engine sequentially on Jetson Nano at the same process, then I reference this sample , update this code and try to test it. But the Bus error (core dumped) message will occur when python script finish. (sametimes the error message is “Segmentation fault (core dumped)”) …

Hi, Do the two models apply to the same input image? If not, it’s recommended to create two processes for each. For Nano, you can try to infer the model with fp16 mode for performance. What kind of model you are using? Detector, classifier, or others? Thanks.

Sorry for the late response, have you managed to get issue resolved or still need the support? Thanks

Hi, Jetson doesn’t support concurrent GPU buffer access. Please find below for a sample to use TensorRT with multi-threads: [image] How to use TensorRT by the multi-threading package of python Jetson AGX Xavier Hi, The sample is ready. The workflow looks like this: Ma…

Hi Thank your answer. But I need to host two model sametimes and run sequentially in my Jetson Nano system. This referenece only use one model. I had try to use torchscript to inferenece model successfully. Next, I want to save memory and speed up inference time, so I hope TensorRT runtime can…

Running Multiple TensorRT Engine Error On Jetson Nano

Robotics & Edge Computing Jetson Systems Jetson Nano

AastaLLL March 29, 2023, 5:47am 4

Hi,

Jetson doesn’t support concurrent GPU buffer access.
Please find below for a sample to use TensorRT with multi-threads:

Thanks.

Topic		Replies	Views
Segmentation Fault (core dumped) occurs when YOLOX is converted to TensorRT Jetson Nano yolo	5	3637	April 4, 2022
Segmentation Fault while using ROS melodic for Inferencing using TensorRT on Jetson Nano Jetson Nano tensorrt , ros , cuda , kernel , yolo , pycuda , jetson-nano	4	862	December 2, 2023
Running Multiple TensorRT Engines On Jetson AGX Jetson AGX Xavier tensorrt , yolo	1	2623	June 24, 2021
Jetson Nano TensorRT heisenbug Jetson Nano tensorrt	15	1717	April 29, 2021
TensorRT Inference error on Jetson nano TensorRT	3	1305	December 6, 2021
Please Help : TensorRT with Thread ERROR : 1: [pointWiseV2Helpers.h::launchPwgenKernel::532] Error Code 1: Cuda Driver (invalid resource handle) Jetson Nano tensorrt	3	1108	June 13, 2022
Yolov5 + TensorRT results seems weird on Jetson Nano 4GB TensorRT	5	2239	January 24, 2022
How to use TensorRT by the multi-threading package of python Jetson AGX Xavier tensorrt	12	19649	March 17, 2021
Tensorrt threading error TensorRT	1	566	July 19, 2022
TensorRT Inference error on Jetson nano Jetson Nano tensorrt	27	3498	January 18, 2022

Running Multiple TensorRT Engine Error On Jetson Nano

Related topics