"Pulsing" in image at iframeinterval when using nvv4l2-enc instead of omx-enc

Here is an example of what I mean. First the blurry frame, then a subsequent sharper frame. 29 out of 30 frames look like the bottom, sharp, one. One in 30 looks like the blurry one.

Blurry:

Sharp: