Cuda install failed on ubuntu 20.04 with driver 510.60.02


I have a newly installed ubuntu 20.04 on a dual boot SSD (the other os is Windows 10). My computer has two GPUs (Quadro RTX 5000). I have cuda 11.4.4 installed on the Windows 10 and develop some app with it. Everything works fine with cuda on my Windows 10.

I need to port my cuda app from Windows to ubuntu. After I have ubuntu running, I install GPU driver 510.60.02. Then I try to install cuda 11.4.4 by following install instructions from nvidia website, as follows:

sudo mv /etc/apt/preferences.d/cuda-repository-pin-600
sudo dpkg -i cuda-repo-ubuntu2004-11-4-local_11.4.4-470.82.01-1_amd64.deb
sudo apt-key add /var/cuda-repo-ubuntu2004-11-4-local/
sudo apt-get update
sudo apt-get -y install cuda

I don’t see any problem except at the last step, it gives me this error:

$ sudo apt-get -y install cuda
Reading package lists… Done
Building dependency tree
Reading state information… Done
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:

The following packages have unmet dependencies:
cuda : Depends: cuda-11-4 (>= 11.4.4) but it is not going to be installed
E: Unable to correct problems, you have held broken packages.

I search web for help but at no avail. Would anyone here help me on this problem?

Thanks and with Best Regards