nvidia-smi suddenly failed on 2080 Ti, driver 401.48 installed from cuda-10-0 deb

Dear forum administers,

I accidentally got a Nvidia-smi failure on my desktop, with an NVIDIA 2080 Ti and a i7 integrated llvmpipe as my graphics stack. I installed the driver 401.48 installed through cuda-10-0 deb. My Nvidia-bug-report.log.gz is attached at:

https://paste.ubuntu.com/p/QVNybzgP2S/

Thanks for the help.

Two steps I got wrong:

  1. Does not fully clean up CUDA

sudo apt autoremove cuda-*

  1. Does not use gcc. Instead my system default is clang 6.0.

sudo update-alternatives --config c++
sudo update-alternatives --config cc

After resolved both issues I could build the driver and installed through .run file.