V4l2-ctl not respecting frame_rate control, unlike Gstreamer on IMX477 + Nano 2GB

The MMAPI have 12_camera_v4l2_cuda and v4l2cuda but both of them are for YUV sensor.
Also should be able found from web like v4l2 capture example · GitHub