RTSP stream delay / Pipeline optimization

The latency may be from the source. We suggest try this setup:
Jetson Nano FAQ

Q: Is there an example for running UDP streaming?

To check how much latency is seen while using videotestsrc in UDP. And may try your source in UDP. We suggest try different combinations to identify where the latency if from and how much the latency is.