Hi, I’m trying to concurrently run 3 networks. 1 on DLA0, 1 on DLA1 and the third on the GPU, using the setDefaultDeviceType and setDLACore functions. I’m using TensorRT 5. After building the 3 networks (which seems to be doing the work correctly), I use the following code to launch them togethe…

Hi, Here is a sample to run GPU and DLAs at the same time. 1. Please prepare TensorRT engine of GPU and DLA with trtexec first. For example, $ /usr/src/tensorrt/bin/trtexec --onnx=/usr/src/tensorrt/data/mnist/mnist.onnx --saveEngine=gpu.engine $ /usr/src/tensorrt/bin/trtexec --onnx=/usr/src/tens…

DLA and GPU cores at the same time

Autonomous Machines Jetson & Embedded Systems Jetson AGX Xavier

juns May 8, 2020, 1:43am 5

I guess it’s because you run them in the same thread.
Would you try it in same process but separate thread?

How can I use createExecutionContextWithoutDeviceMemory()/IExecutionContext::setDeviceMemory()