Suggest you run in CBR mode and adjust virtual buffer size. Virtual buffer size is recommended in 0.75*(bitrate/fps) ~ 2*(bitrate/fps).
We don’t have the property of enabling stringent bitrate in v4l2 plugins. In the mode, the size of IDR/I frames is stringent and may lead to worse quality. Suggest you try CBR + vbv-size first.