Xfce can't fully start for some obscure reason and I can't use ubuntu 20.04 with the kernel 4.9 + jetpack 32.7 and kvm enabled

[_Diablo]

You re-check if in /etc/X11/xorg.conf if disabled # Driver nvidia line

Check this tweaks Importants Tweaks for not break Nvidia GPU drivers and some mainline Ubuntu stuff

This working fine for me up to Ubuntu 22.04 tested working X11 acelerating fine.