Hi,
The latency may be from network and source. Please try this setup:
Gstreamer TCPserversink 2-3 seconds latency - #5 by DaneLLL
It network bandwidth is enough, you should see neglectable latency in the setup. So the setup can show latency in network. And then please try with v4l2src plugin to identify latency from the camera source.