How to find the processor occupancy of a model and accommodate multiple engines

Hi all, I want to know how to find out how many cores an engine occupies. If even after it is being executed and more number of cores still unused can we make multiple instances of this engine or context to be run on the remaining cores.

Please clarify.

Thanks and Regards

Nagaraj Trivedi


It looks like this issue duplicates to topic 278128:

We don’t have such information but you can monitor GPU utilization with tegrastats.

$ sudo tegrastats

TensorRT usually occupies ~99% GPU utilization.
If the GPU utilization is not high, please check if the GPU needs to wait for input to compute.


This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.