Hi,
Probably the network is not stable so the stream is not well received. You may try UDP streaming for comparison:
Gstreamer TCPserversink 2-3 seconds latency - #5 by DaneLLL
We can run this smoothly and see good video preview. Please check if it works well in your environment.