Gstreamer RSTP server with nvcompositor latency increases as time goes by

Hi,
I’m using 1.16.3 found by gst-inspect-1.0 --gst-version.
I don’t have usb or bayer right now, I can try with videotestsrc but how can I check latency with that?

I applied vic frequency as maximum and I’m testing it now. If it resolve this problem I’ll let you know.

And I’m planning to apply below patches

I’ll download source code at below site