High CPU usage on xorg when the external monitor is plugged in

Same problem here, not with hybrid graphics but with an actual graphics card (RTX 3080), I have provided an exhaustive list of the troubleshooting steps I took while trying to fix this problem as well as a bug-report log in this thread : Very High Xorg CPU usage using latest Drivers with an RTX 3080