Monitors literally stutter when VRR/G-SYNC is enabled

Here is a gif to illustrate the issue (on Windows, no game running):
vrr_stutters

The big number on top left corner is the monitor 1 refresh rate: it drops very shortly to 49 Hz when GPU clock changes.