The source is 15fps in your environment, and batched-push-timeout has to be tuned accordingly. Also using nvoverlaysink can save some GPU resource. Please run with sudo jetson_clocks
And please also check the power supply:
Insufficient current may trigger performance drop.