Please try creating /etc/X11/xorg.conf
Section "ServerLayout"
Identifier "Layout0"
Option "AutoAddGPU" "false"
EndSection
Section "Device"
Identifier "nvidia"
Driver "nvidia"
BusID "PCI:65:0:0"
Option "ProbeAllGpus" "False"
EndSection
I suspect the A100 get added as virtual display.