How to test the pipeline latency of deepstream test3?

No, you can use the following command line to test the performance, but the testing doesn’t include network/decode/form batch elapsed time. For DeepStream pipeline, It will be worse than this value.

/usr/src/tensorrt/bin/trtexec --loadEngine=xxxx.engine --iterations=100 --avgRuns=100
GPU Compute Time: min = 25.1663 ms, max = 27.2622 ms, mean = 25.9852 ms, median = 26.0652 ms, percentile(90%) = 26.6188 ms, percentile(95%) = 26.7308 ms, percentile(99%) = 26.8392 ms

For the property, refer to this FAQ.

This is why I recommend using local files to measure latency. Network delays can cause some inaccuracies in measurements.