Hi,
Some latency can be from the source. Please try this setup which uses videotestsrc and check the latency:
Gstreamer TCPserversink 2-3 seconds latency - #5 by DaneLLL
videotestsrc doesn’t have latency. We can roughly know the latency of the source(v4l2src)