Trtexec related question

Hi,
How can I make trtexec to concurrently run two different plan files, one on the gpu and one on the DLA?
Is it only by running two different trtexecs? can I cause it to use one trtexec with two threads/streams, each
running a different serialized plan file?

thanks
Eyal

Hi,

This can be done in the same process but needs two independent engine for each model.
You can modify trtexec to handle this in /usr/src/tensorrt/samples/trtexec/.

Thanks.

Thanks for the prompt answer @AastaLLL.
What do you mean by modify? I should change trtexec’s code?
What exactly would the command line be? I don’t see it from the help usage screen…

thanks
Eyal.

Hi,

You will need to modify the source of trtexec.
Currently, it only creates one TensorRT engine, so only one model is allowed.

Thanks.