You can refer to the Enable Latency measurement for deepstream sample apps to get the latency of the nvinfer plugin.