Is TensorRT CudaEngine thread safe ?

AI & Data Science Deep Learning (Training & Inference) TensorRT
1

Hi all,

I created an engine as following in the main thread:
//------------------------------------------------------
IBuilder* builder = createInferBuilder(gLogger);
INetworkDefinition* network = builder->createNetwork();
…
ICudaEngine* engine = builder->buildCudaEngine(*network);

I want to do inference in multi threads, is above engine thread safe?

Regards,
Yan

2

I have exactly the same question.
Looking forward to any suggestion !

3

See NVIDIA Deep Learning TensorRT Documentation