IPC camera preview: latency is getting higher and higher over time

Please execute the steps and check if it helps:

  1. Run sudo nvpmodel -m 0 and sudo jetson_clocks to run system at maximum performance
  2. There are property to enable decoder and encoder in maximum performance mode, please also set the property
  3. Run VIC at maximum clock:
    Nvvideoconvert issue, nvvideoconvert in DS4 is better than Ds5? - #3 by DaneLLL

And not sure what sunk plugin you use in the gstreamer pipeline, but please set sync=false to the plugin and try. It is to disable synchronization mechanism in gstreamer frameworks.