Hi, Purpose: Need to load two TensorRT models at the same time. I am new to jetson and TensorRT. I’ve been trying to implement a CV pipeline in python which needs to use two TensorRT models in a cascade manner. Environment Info TensorRT Version : 7.1 GPU Type : GTX 1070 Nvidia Driver Version :…

HI @AakankshaS , I was able to solve this error. According to the Thread Safety section, it seems to be that a single CUDA context can be used by multiple TensorRT builders and execution contexts. [image] Htut: 2.4. Thread Safety The TensorRT builder may only be used by one thread at a time. If…

Unable to run two TensorRT models in a cascade manner

AI & Data Science Deep Learning (Training & Inference) TensorRT

AakankshaS August 4, 2020, 10:52am 2

Hi @Htut,

As per the error, this looks like a thread issue.
Please ensure you are using the guidelines as per the document.

Alternatively, you can use Deepstream to run multiple models.

Thanks!