I want to add a note: There is another driver, beyond what you are thinking about, involved when running in the GUI. This driver dynamically loads in the X server itself, and lives in user space (it isn’t a kernel driver in the usual sense). This excerpt is not from a Jetson, but illustrates, and is from Ubuntu 20:
[ 10.951] (II) Module ABI versions:
[ 10.951] X.Org ANSI C Emulation: 0.4
[ 10.951] X.Org Video Driver: 24.1
[ 10.951] X.Org XInput driver : 24.1
[ 10.951] X.Org Server Extension : 10.0
The above lists the binary interface version for several dynamically loadable drivers. The video driver is the NVIDIA GPU, the XInput driver is for mouse and keyboard. I’m thinking the failure is in that driver, and not in failure to recognize the mouse or keyboard.
If you look at the logs (text mode console should work, so should ssh and serial console), then while the system is running you can find the Xorg log. The log listed via this command will be the log of interest:
ls -ltr /var/log/Xorg.*.log | tail -n 1
Can you attach that log to the forum?