Hi all, Purpose: So far I need to put the TensorRT in the second threading. I have read this document but I still have no idea how to exactly do TensorRT part on python. I already have a sample which can successfully run on TRT. Now I just want to run a really simple multi-threading code with T…

Hi, The sample is ready. The workflow looks like this: Master: create TensorRT engine and buffer, store the created CUDA context. Thread1: restore master’s CUDA context, run inference, destroy its CUDA context. Master: destroy the stored CUDA context. The sample is created with TensorRT default …

How to use TensorRT by the multi-threading package of python

Autonomous Machines Jetson & Embedded Systems Jetson AGX Xavier

AastaLLL May 15, 2020, 2:19am 3

Hi,

We have a multi-threading TensorRT example for C++ here:

I will check your python sample and update more information with you later.
In general, you will need to create different context for the TensorRT to isolate the working environment.

Thanks.

2 Likes