Why is CPU usage high while GPU usage normal in detectnet application

Hi

When running the detectnet program or our own custom python code which is based on detectnet, we can see a high CPU usage ~90% while GPU usage keeps fluctuating between 40 to 80%. Does that means we are not fully using the GPU? How come CPU usages are high if all the inferencing is done on GPU?

Attached is the screenshot. I am using Jetson Nano in 5W mode.

Hi,

Usually, the CPUs are occupied by some pre-processing and memory copy.
You might meet some data bottleneck so the GPU utilization cannot reach 99%.
(GPU is waiting for data input sometimes)

Thanks.