Delay due to nvinfer

[junshengy]

sudo pip3 install jetson-stats
jtop

1.Please check the GPU usage through jtop first.

2.It seems that you are not using int8 models, which can reduce GPU usage

Refer to the FAQ below to measure latency of every element. When measuring, please use local files to avoid the impact of network latency.

DeepStream SDK FAQ

7. [DS 5.0GA_All_App] Enable Latency measurement for deepstream sample apps If you are using deepstream-app, to check the component latency directly, you need to set the env export NVDS_ENABLE_COMPONENT_LATENCY_MEASUREMENT=1 export NVDS_ENABLE_LATENCY_MEASUREMENT=1 If you are using other deepstream sample apps such as deepstream-test3, you need to apply the following patch and set the env export NVDS_ENABLE_COMPONENT_LATENCY_MEASUREMENT=1 export NVDS_ENABLE_LATENCY_MEASUREMENT=1 …