Hi,
Please try to link nvv4l2camerasrc ! videorate for a try. There is discussion in the topic and this is suggested for Jetpack 5.0.2:
GStreamer nvvidconv performance/cost (UYVY to NV12 for nvv4l2h264enc) - #13 by DaneLLL
Please give it a try and see if the issue is still present.