Hi,
Please refer to the cases of UDP streaming:
Jetson 4k Encoding -> Decoding Pipeline and latency - #11 by DaneLLL
Delay in video - #5 by DaneLLL
If your source is in steady rate, we suggest disable synchronization mechanism in gstreamer by setting sync=0 in client pipeline for a try.