Inside the Tiler Probe in “back to back detector” example I have put a heavy parsing function that also draws lines by acquiring getting display meta pool and adding lines to it. This is causing massive frame skips for some reason.
It is not advisable to have compute intensive functions to be implemented in the probe as it is a blocking call. Instead write a separate gstreamer plugin. Refer to sample dsexample plugin
I fixed it by increasing the max-lateness of the display sink.