Fail to compile samples after install cudatoolkit 9.0

I follow the official documentation carefully and It seems that I have successfully installed cudatoolkit 9.0. (Please see output of nvcc -version and nvidia-smi below). I am using Nvidia driver version 384.183, which satisfies the requirement for cuda-9.0 (version >=384).

But I can’t compile any samples, here is the example when I compile the samples in /home/Kong/NVIDIA_CUDA-9.0_Samples/1_Utilities/deviceQuery/, it comes out the errors:

"/usr/local/cuda-9.0"/bin/nvcc -ccbin g++ -I../../common/inc  -m64    -gencode arch=compute_30,code=sm_30 -gencode arch=compute_35,code=sm_35 -gencode arch=compute_37,code=sm_37 -gencode arch=compute_50,code=sm_50 -gencode arch=compute_52,code=sm_52 -gencode arch=compute_60,code=sm_60 -gencode arch=compute_70,code=sm_70 -gencode arch=compute_70,code=compute_70 -o deviceQuery.o -c deviceQuery.cpp</li>
In file included from deviceQuery.cpp:20:0:
../../common/inc/helper_cuda.h: In function 'const char* _cudaGetErrorEnum(cudaError_t)':
../../common/inc/helper_cuda.h:285:14: error: 'cudaErrorNvlinkUncorrectable' was not declared in this scope
         case cudaErrorNvlinkUncorrectable :
              ^
../../common/inc/helper_cuda.h:289:14: error: 'cudaErrorJitCompilerNotFound' was not declared in this scope
         case cudaErrorJitCompilerNotFound :
              ^
../../common/inc/helper_cuda.h:293:14: error: 'cudaErrorCooperativeLaunchTooLarge' was not declared in this scope
         case cudaErrorCooperativeLaunchTooLarge :
              ^
deviceQuery.cpp: In function 'int main(int, char**)':
deviceQuery.cpp:172:84: error: 'struct cudaDeviceProp' has no member named 'cooperativeLaunch'
 erative Kernel Launch:            %s\n", deviceProp.cooperative
                                                     ^
deviceQuery.cpp:173:84: error: 'struct cudaDeviceProp' has no member named 'cooperativeMultiDeviceLaunch'
 iDevice Co-op Kernel Launch:      %s\n", deviceProp.cooperative
                                                     ^
Makefile:273: recipe for target 'deviceQuery.o' failed
make: *** [deviceQuery.o] Error 1

It seems all the samples I compile have the problem with helper_cuda.h.

Here is the device information

$ nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2017 NVIDIA Corporation
Built on Fri_Sep__1_21:08:03_CDT_2017
Cuda compilation tools, release 9.0, V9.0.176
$ nvidia-smi
Tue Oct 29 16:45:10 2019
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 384.183      Driver Version: 384.183      CUDA Version: 9.0      |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|===============================+======================+======================|
|   0  Tesla V100-DGXS...  On   | 00000000:07:00.0  On |                    0 |
| N/A   35C    P0    38W / 300W |    101MiB / 32496MiB |      0%      Default |
+-------------------------------+----------------------+----------------------+
|   1  Tesla V100-DGXS...  On   | 00000000:08:00.0 Off |                    0 |
| N/A   35C    P0    38W / 300W |     10MiB / 32499MiB |      0%      Default |
+-------------------------------+----------------------+----------------------+
|   2  Tesla V100-DGXS...  On   | 00000000:0E:00.0 Off |                    0 |
| N/A   35C    P0    38W / 300W |     10MiB / 32499MiB |      0%      Default |
+-------------------------------+----------------------+----------------------+
|   3  Tesla V100-DGXS...  On   | 00000000:0F:00.0 Off |                    0 |
| N/A   36C    P0    37W / 300W |     10MiB / 32499MiB |      0%      Default |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                       GPU Memory |
|  GPU       PID   Type   Process name                             Usage      |
|=============================================================================|
|    0      1603      G   /usr/lib/xorg/Xorg                            89MiB |
+-----------------------------------------------------------------------------+

I have already add the PATH to my .zshrc file by adding these two lines.

export PATH=/usr/local/cuda-9.0/bin${PATH:+:${PATH}}
export LD_LIBRARY_PATH=/usr/local/cuda-9.0/lib64${LD_LIBRARY_PATH:+:${LD_LIBRARY_PATH}}

Here is the echo:

$ echo $PATH
/home/Kong/anaconda2/bin:/usr/local/cuda-9.0/bin:/home/Kong/anaconda2/bin:/usr/local/cuda-9.0/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
$ echo $LD_LIBRARY_PATH
/usr/local/cuda-9.0/lib64

I have no idea what’s wrong with it, please help me fix this problem.

Your install appears to be mismatched somehow.

What is the result of running:

which nvcc

and

/usr/local/cuda-9.0/bin/nvcc --version

?

Hello Robert,

The output is:

$ which nvcc
/usr/local/cuda-9.0/bin/nvcc
$ /usr/local/cuda-9.0/bin/nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2017 NVIDIA Corporation
Built on Fri_Sep__1_21:08:03_CDT_2017
Cuda compilation tools, release 9.0, V9.0.176

what is the result of:

grep cudaErrorNvlink /usr/local/cuda-9.0/include/*.h

?

The result is

$ grep cudaErrorNvlink /usr/local/cuda-9.0/include/*.h
/usr/local/cuda-9.0/include/driver_types.h:    cudaErrorNvlinkUncorrectable          =     80,

Change to this directory:

/home/Kong/NVIDIA_CUDA-9.0_Samples/1_Utilities/deviceQuery/

run this command:

/usr/local/cuda-9.0/bin/nvcc --verbose -ccbin g++ -I…/…/common/inc -m64 -gencode arch=compute_30,code=sm_30 -o deviceQuery.o -c deviceQuery.cpp

and paste the output here

The output is

$ cd /home/Kong/NVIDIA_CUDA-9.0_Samples/1_Utilities/deviceQuery/
$ /usr/local/cuda-9.0/bin/nvcc --verbose -ccbin g++ -I../../common/inc -m64 -gencode arch=compute_30,code=sm_30 -o deviceQuery.o -c deviceQuery.cpp
#$ _SPACE_=
#$ _CUDART_=cudart
#$ _HERE_=/usr/local/cuda-9.0/bin
#$ _THERE_=/usr/local/cuda-9.0/bin
#$ _TARGET_SIZE_=
#$ _TARGET_DIR_=
#$ _TARGET_DIR_=targets/x86_64-linux
#$ TOP=/usr/local/cuda-9.0/bin/..
#$ NVVMIR_LIBRARY_DIR=/usr/local/cuda-9.0/bin/../nvvm/libdevice
#$ LD_LIBRARY_PATH=/usr/local/cuda-9.0/bin/../lib:/usr/local/cuda-9.0/lib64
#$ PATH=/usr/local/cuda-9.0/bin/../open64/bin:/usr/local/cuda-9.0/bin/../nvvm/bin:/usr/local/cuda-9.0/bin:/home/Kong/anaconda2/bin:/usr/local/cuda-9.0/bin:/home/Kong/anaconda2/bin:/usr/local/cuda-9.0/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games
#$ INCLUDES="-I/usr/local/cuda-9.0/bin/../targets/x86_64-linux/include"
#$ LIBRARIES=  "-L/usr/local/cuda-9.0/bin/../targets/x86_64-linux/lib/stubs" "-L/usr/local/cuda-9.0/bin/../targets/x86_64-linux/lib"
#$ CUDAFE_FLAGS=
#$ PTXAS_FLAGS=
#$ g++ -c -x c++ -D__NVCC__  -I"../../common/inc" "-I/usr/local/cuda-9.0/bin/../targets/x86_64-linux/include"   -D"__CUDACC_VER_BUILD__=176" -D"__CUDACC_VER_MINOR__=0" -D"__CUDACC_VER_MAJOR__=9" -m64 -o "deviceQuery.o" "deviceQuery.cpp"
In file included from deviceQuery.cpp:20:0:
../../common/inc/helper_cuda.h: In function 'const char* _cudaGetErrorEnum(cudaError_t)':
../../common/inc/helper_cuda.h:285:14: error: 'cudaErrorNvlinkUncorrectable' was not declared in this scope
         case cudaErrorNvlinkUncorrectable :
              ^
../../common/inc/helper_cuda.h:289:14: error: 'cudaErrorJitCompilerNotFound' was not declared in this scope
         case cudaErrorJitCompilerNotFound :
              ^
../../common/inc/helper_cuda.h:293:14: error: 'cudaErrorCooperativeLaunchTooLarge' was not declared in this scope
         case cudaErrorCooperativeLaunchTooLarge :
              ^
deviceQuery.cpp: In function 'int main(int, char**)':
deviceQuery.cpp:172:84: error: 'struct cudaDeviceProp' has no member named 'cooperativeLaunch'
         printf("  Supports Cooperative Kernel Launch:            %s\n", deviceProp.cooperativeLaunch ? "Yes" : "No");
                                                                                    ^
deviceQuery.cpp:173:84: error: 'struct cudaDeviceProp' has no member named 'cooperativeMultiDeviceLaunch'
         printf("  Supports MultiDevice Co-op Kernel Launch:      %s\n", deviceProp.cooperativeMultiDeviceLaunch ? "Yes" : "No");
                                                                                    ^
# --error 0x1 --

what is the result of running:

grep cudaErrorNvlink /usr/local/cuda-9.0/targets/x86_64-linux/include

The result is

$ grep cudaErrorNvlink /usr/local/cuda-9.0/targets/x86_64-linux/include
grep: /usr/local/cuda-9.0/targets/x86_64-linux/include: No such file or directory

That’s the problem. The CUDA 9.0 install appears to be broken. It is expecting a /usr/local/cuda-9.0/targets/x86_64-linux/include directory, but that directory does not exist on your machine.

(Note that the command I gave you was slightly incorrect, I should have asked you to do this:

grep cudaErrorNvlink /usr/local/cuda-9.0/targets/x86_64-linux/include/*.h

but the result would be the same.)

The output is

$ grep cudaErrorNvlink /usr/local/cuda-9.0/targets/x86_64-linux/include/*.h
zsh: no matches found: /usr/local/cuda-9.0/targets/x86_64-linux/include/*.h

right, this is indicating that that directory does not exist, I believe

So how can I fix it?

You’re on a DGX station, correct?

The first thing I would do is make sure your DGX station is properly updated to the latest software version:

[url]DGX Station User Guide :: DGX Systems Documentation

Make sure that is updated and working correctly first (compile and run CUDA samples using whatever version of CUDA is installed by the software update).

Then, if you wanted to also use CUDA 9.0, I would install that separately, using the runfile installer, and I would deselect the option to use the bundled driver (deselect the driver install in the runfile installer).

get your cuda 9.0 runfile installer from [url]http://www.nvidia.com/getcuda[/url]

follow the runfile install instructions in the CUDA linux install guide:

after that, the CUDA samples for CUDA 9.0 will be at the usual place, and you should be able to do sudo make -k in that directory (/usr/local/cuda-9.0/samples)

Yes, I am using DGX station.

The way I installed cudatoolkit 9.0 is by using the runfile installer, and I deselected the driver install since I have already installed it.

Oh I remind one thing to mention is that before I installed 9.0, when I run

$ nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2015 NVIDIA Corporation
Built on Tue_Aug_11_14:27:32_CDT_2015
Cuda compilation tools, release 7.5, V7.5.17

It shows that it already has cudatoolkit 7.5.

Next I will uninstall cudatoolkit 9.0 and follow the way you said.

CUDA 7.5 would not ever have been a correct install for DGX Station. It does not support the Tesla V100 devices in DGX station. So I would say your machine has a questionable history and it may not be possible to sort out what is happening.

Initially there exist cudatoolkit 9.0, but I do not see cudnn and cudatoolkit after I run “pip list”. So I follow the suggestions people said to reinstall anaconda and python and take a series of action below, may be it go wrong when I uninstall anaconda since after I uninstall anaconda by

rm -rf ~/anaconda2

, the nvcc --version turns to 7.5.

I have no idea which operation cause this problem, so I list my command history here.

261  26.10.2019 09:18  python test_sky_estimate.py
  262  26.10.2019 09:18  python --version
  263  26.10.2019 09:19  python
  264  26.10.2019 09:22  ls
  265  26.10.2019 09:22  vi test_sky_estimate.py
  266  26.10.2019 09:26  python test_sky_estimate.py
  267  26.10.2019 09:28  vi test_sky_estimate.py
  268  26.10.2019 09:39  python
  269  26.10.2019 09:48  vi test_sky_estimate.py
  270  26.10.2019 09:52  conda install pytorch torchvision -c pytorch
  271  26.10.2019 10:22  ls
  272  26.10.2019 10:22  vi .zshrc
  273  26.10.2019 11:01  conda install pytorch torchvision -c pytorch
  274  26.10.2019 11:02  python --version
  275  26.10.2019 11:02  which python
  276  26.10.2019 11:02  cat -n .zshrc
  277  26.10.2019 11:04  python test_sky_estimate.py
  278  26.10.2019 11:11  nvidia-smi
  279  26.10.2019 11:12  pip list
  280  26.10.2019 14:41  ls
  281  26.10.2019 14:41  vi examples.desktop
  282  26.10.2019 14:42  pip uninstall cudnn
  283  26.10.2019 14:42  pip uninstall cudatoolkit
  284  26.10.2019 14:43  pip install cudatoolkit=9.0
  285  26.10.2019 14:43  pip install cudatoolkit==9.0
  286  26.10.2019 14:43  pip install cudatoolkit
  287  26.10.2019 14:43  pip install cudnn
  288  26.10.2019 14:48  nvcc --version
  289  26.10.2019 14:49  python test_sky_estimate.py
  290  26.10.2019 14:50  sudo ubuntu-drivers autoinstall
  291  26.10.2019 14:54  conda install -c anaconda cudatoolkit
  292  26.10.2019 14:55  which nvcc
  293  26.10.2019 14:56  nvcc --version
  294  26.10.2019 14:56  cat /proc/driver/nvidia/version
  295  26.10.2019 14:59  cat /usr/local/cuda/version.txt
  296  26.10.2019 15:00  whereis cuda
  297  26.10.2019 15:01  exit
  298  26.10.2019 15:02  vi test_sky_estimate.py
  299  26.10.2019 15:04  sudo apt install nvidia-cuda-toolkit
  300  26.10.2019 15:41  sudo reboot
  301  26.10.2019 15:43  python test_sky_estimate.py
  302  26.10.2019 15:44  nvcc --version
  303  26.10.2019 15:52  nvidia-smi
  304  26.10.2019 15:53  pip list
  305  26.10.2019 16:14  python
  306  26.10.2019 16:14  python --version
  307  26.10.2019 16:14  python
  308  26.10.2019 16:16  python test_sky_estimate.py
  309  26.10.2019 16:25  pip list
  310  26.10.2019 16:27  conda uninstall pytorch torchvision -c pytorch
  311  26.10.2019 16:30  conda install pytorch=0.4.1 cuda90 -c pytorch
  312  26.10.2019 16:30  conda
  313  26.10.2019 16:30  conda --version
  314  26.10.2019 16:30  python --version
  315  26.10.2019 16:32  which python
  316  26.10.2019 16:34  conda install -c anaconda cudatoolkit
  317  26.10.2019 16:34  which anaconda
  318  26.10.2019 16:36  which python
  319  26.10.2019 16:37  ln python3.6 python
  320  26.10.2019 16:38  ln -s python3 python
  321  26.10.2019 16:38  conda install pytorch=0.4.1 cuda90 -c pytorch
  322  26.10.2019 16:41  anaconda --version
  323  26.10.2019 16:42  pydoc conda
  324  26.10.2019 16:48  cd ..
  325  26.10.2019 16:48  ls
  326  26.10.2019 16:48  cd ..
  327  26.10.2019 16:48  sl
  328  26.10.2019 16:48  ls
  329  26.10.2019 16:49  mkdir envirbackup
  330  26.10.2019 16:49  cd envirbackup
  331  26.10.2019 16:49  pwd
  332  26.10.2019 16:49  cp -R ~/anaconda2/envs/* /home/Kong/envirbackup
  333  26.10.2019 16:49  cd ~/anaconda2/envs
  334  26.10.2019 16:49  ls
  335  26.10.2019 16:50  rm -rf ~/anaconda2
  336  26.10.2019 16:50  python --version
  337  26.10.2019 16:50  python
  338  26.10.2019 17:07  pip list
  339  26.10.2019 17:07  pip --version
  340  26.10.2019 17:09  ls
  341  26.10.2019 17:10  sudo sh Anaconda2-2019.10-Linux-x86_64.sh
  342  26.10.2019 17:11  ls
  343  26.10.2019 17:12  vi .zshrc
  344  26.10.2019 17:13  conda --version
  345  26.10.2019 17:13  conda update -n base -c defaults conda
  346  26.10.2019 17:13  conda update --all
  347  26.10.2019 17:14  pip --version
  348  26.10.2019 17:14  python --version
  349  26.10.2019 17:14  python
  350  26.10.2019 17:15  pip list
  351  26.10.2019 17:17  exit
  352  26.10.2019 17:59  conda install -c anaconda cudatoolkit
  353  26.10.2019 18:03  conda list
  354  26.10.2019 18:03  nvcc --version
  355  26.10.2019 18:04  nvidia-smi
  356  26.10.2019 18:11  conda uninstall -c anaconda cudatoolkit
  357  26.10.2019 18:13  cat /etc/issue
  358  26.10.2019 18:14  nvcc --version
  359  26.10.2019 19:47  lspci | grep -i nvidia
  360  26.10.2019 19:48  uname 0m && cat /etc/*release
  361  26.10.2019 19:48  uname -m && cat /etc/*release
  362  26.10.2019 19:51  gcc --version
  363  26.10.2019 19:52  uname -r
  364  26.10.2019 19:53  sudo apt-get install linux-headers-4.4.0-116-generic
  365  26.10.2019 20:10  nvcc --version
  366  26.10.2019 20:12  which cuda
  367  26.10.2019 20:14  ls
  368  26.10.2019 20:14  pwd
  369  26.10.2019 20:17  pip list
  370  26.10.2019 20:17  pip install cudatoolkit=9.0
  371  26.10.2019 20:17  pip install cudatoolkit==9.0
  372  26.10.2019 20:19  sudo sh cuda_9.0.176_384.81_linux-run
  373  26.10.2019 20:26  cd /tmp
  374  26.10.2019 20:26  ls
  375  26.10.2019 20:26  rm cuda_install_12254.log
  376  26.10.2019 20:26  ls
  377  26.10.2019 20:26  rm cuda_install_12254.log
  378  26.10.2019 20:26  ls
  379  26.10.2019 20:26  rm cuda_install_12254.log
  380  26.10.2019 20:27  sudo rm cuda_install_12254.log
  381  26.10.2019 20:27  ls
  382  26.10.2019 20:27  sudo sh cuda_9.0.176_384.81_linux-run
  383  26.10.2019 20:27  cd ~
  384  26.10.2019 20:27  sudo sh cuda_9.0.176_384.81_linux-run
  385  26.10.2019 20:29  sudo rm /tmp/.X*-lock
  386  26.10.2019 20:29  sudo sh cuda_9.0.176_384.81_linux-run
  387  26.10.2019 20:31  cat /var/log/nvidia-installer.log
  388  26.10.2019 20:33  sudo sh cuda_9.0.176_384.81_linux-run
  389  26.10.2019 20:37  sudo cuda_9.0.176_384.81_linux-run -silent -driver
  390  26.10.2019 20:57  nvcc --version
  391  26.10.2019 21:02  cd /usr/local/cuda-9.0/bin
  392  26.10.2019 21:02  ls
  393  26.10.2019 21:02  ./uninstall_cuda_9.0.pl
  394  26.10.2019 21:02  sudo ./uninstall_cuda_9.0.pl
  395  26.10.2019 21:03  sudo apt install cuda-toolkit-9-0
  396  26.10.2019 21:03  nvcc --version
  397  26.10.2019 21:04  pip list
  398  26.10.2019 21:04  cd ~
  399  26.10.2019 21:04  pip list
  400  26.10.2019 21:06  nvcc --version
  401  26.10.2019 21:06  nvcc -update
  402  26.10.2019 21:06  nvcc --update
  403  26.10.2019 21:16  nvcc --version
  404  26.10.2019 21:16  sudo apt install cuda-toolkit-9-0
  405  27.10.2019 08:44  ls
  406  27.10.2019 08:47  nvcc --version
  407  27.10.2019 08:48  cd /usr/local
  408  27.10.2019 08:48  ls
  409  27.10.2019 08:49  cd bin
  410  27.10.2019 08:49  ls
  411  27.10.2019 08:49  cd ..
  412  27.10.2019 08:49  cd etc
  413  27.10.2019 08:49  ls
  414  27.10.2019 08:49  cd ../games
  415  27.10.2019 08:49  l
  416  27.10.2019 08:49  ls
  417  27.10.2019 08:49  cd ../include
  418  27.10.2019 08:49  ls
  419  27.10.2019 08:49  cd ../lib
  420  27.10.2019 08:49  ls
  421  27.10.2019 08:49  cd ../man
  422  27.10.2019 08:49  ls
  423  27.10.2019 08:49  cd ../sbin
  424  27.10.2019 08:49  ls
  425  27.10.2019 08:49  cd ../share
  426  27.10.2019 08:49  ls
  427  27.10.2019 08:50  cd ..src
  428  27.10.2019 08:50  sudo apt install cuda-toolkit-9-0
  429  27.10.2019 08:51  nvcc --version
  430  27.10.2019 08:51  cd /usr
  431  27.10.2019 08:51  ls
  432  27.10.2019 08:51  cd locale
  433  27.10.2019 08:51  ls
  434  27.10.2019 08:51  cd ../share
  435  27.10.2019 08:51  ls
  436  27.10.2019 08:52  which cuda
  437  27.10.2019 08:52  nvidia-smi
  438  27.10.2019 08:52  ls
  439  27.10.2019 08:53  sudo sh cuda_9.0.176_384.81_linux-run
  440  27.10.2019 08:59  service nvidia-docker stop
  441  27.10.2019 09:00  nvidia-smi
  442  27.10.2019 09:11  ls
  443  27.10.2019 09:11  sudo service lightdm stop
  444  27.10.2019 09:11  ls
  445  27.10.2019 09:12  nvidia-smi
  446  27.10.2019 09:12  ls
  447  27.10.2019 09:12  sudo sh cuda_9.0.176_384.81_linux-run
  448  27.10.2019 09:16  nvcc --version
  449  27.10.2019 09:16  ls
  450  27.10.2019 09:16  cd /usr/local
  451  27.10.2019 09:16  ls
  452  27.10.2019 09:17  cd cuda
  453  27.10.2019 09:17  ls
  454  27.10.2019 09:17  cat version.txt
  455  27.10.2019 09:17  cd ../cuda-9.0
  456  27.10.2019 09:17  ls
  457  27.10.2019 09:17  cd bin
  458  27.10.2019 09:17  ls
  459  27.10.2019 09:17  ./uninstall_cuda_9.0.pl
  460  27.10.2019 09:17  sudo ./uninstall_cuda_9.0.pl
  461  27.10.2019 09:18  cd ~
  462  27.10.2019 09:18  ls
  463  27.10.2019 09:18  sudo sh cuda_9.0.176_384.81_linux-run
  464  27.10.2019 09:20  cat /var/log/nvidia-installer.log
  465  27.10.2019 09:23  cd /usr/local/
  466  27.10.2019 09:23  ls
  467  27.10.2019 09:23  cd /usr
  468  27.10.2019 09:23  ls
  469  27.10.2019 09:23  cd local
  470  27.10.2019 09:23  ls
  471  27.10.2019 09:23  cd /usr/local
  472  27.10.2019 09:25  lsof /dev/nvidia*
  473  27.10.2019 09:25  cd ~
  474  27.10.2019 09:25  lsof /dev/nvidia*
  475  27.10.2019 09:26  service nvidia-docker stop
  476  27.10.2019 09:26  sudo sh cuda_9.0.176_384.81_linux-run
  477  27.10.2019 09:28  cat -n /var/log/nvidia-installer.log
  478  27.10.2019 09:29  sudo service lightdm stop
  479  27.10.2019 09:29  sudo stop nvidia-digits-server
  480  27.10.2019 09:29  sudo rmmod nvidia-modeset
  481  27.10.2019 09:30  ps a | grep X
  482  27.10.2019 09:31  sudo modprobe -r nvidia
  483  27.10.2019 09:31  ps a | grep X
  484  27.10.2019 09:35  remove nvidia rmmod nvidia-modeset nvidida
  485  27.10.2019 09:36  ls
  486  27.10.2019 09:36  nvidia-smi
  487  27.10.2019 09:38  lsmod | grep nvidia
  488  27.10.2019 09:38  rmmod -f
  489  27.10.2019 09:39  rmmod -f nvidia-modeset
  490  27.10.2019 09:39  sudo rmmod -f nvidia-modeset
  491  27.10.2019 09:39  lsmod | grep nvidia
  492  27.10.2019 09:40  sudo systemctl stop systemd-logind
  493  27.10.2019 09:40  lsmod | grep nvidia
  494  27.10.2019 09:46  lsmod | grep nouveau
  495  27.10.2019 09:47  vi /etc/modprobe.d/blacklist-nouveau.conf
  496  27.10.2019 09:48  ls
  497  27.10.2019 09:48  cd /etc/modprobe.d
  498  27.10.2019 09:48  ls
  499  27.10.2019 09:51  cp blacklist-ath_pci.conf blacklist-nouveau.conf
  500  27.10.2019 09:51  sudo cp blacklist-ath_pci.conf blacklist-nouveau.conf
  501  27.10.2019 09:51  vi blacklist-nouveau.conf
  502  27.10.2019 09:54  ls
  503  27.10.2019 09:54  rm blacklist-nouveau.conf
  504  27.10.2019 09:54  ls
  505  27.10.2019 09:54  sudo rm blacklist-nouveau.conf
  506  27.10.2019 09:54  ls
  507  27.10.2019 09:54  sudo update-initramfs -u
  508  27.10.2019 09:55  exit
  509  27.10.2019 09:55  lsmod | grep nvidia
  510  27.10.2019 09:55  uname -r
  511  27.10.2019 09:56  sudo apt-get install linux-headers-4.4.0-116-generic
  512  27.10.2019 09:58  cd /usr/bin
  513  27.10.2019 09:58  ls
  514  27.10.2019 09:58  ls | grep unistall
  515  27.10.2019 09:58  ls | grep nvidia
  516  27.10.2019 10:00  lspci | grep -i nvidia
  517  27.10.2019 10:01  cd /etc/modprobe.d
  518  27.10.2019 10:01  ls
  519  27.10.2019 10:02  cp blacklist-oss.conf blacklist-nouveau.conf
  520  27.10.2019 10:02  sudo cp blacklist-oss.conf blacklist-nouveau.conf
  521  27.10.2019 10:37  chmod a+r blacklist-nouveau.conf
  522  27.10.2019 10:37  sudo chmod a+r blacklist-nouveau.conf
  523  27.10.2019 10:37  vi blacklist-nouveau.conf
  524  27.10.2019 10:38  ls
  525  27.10.2019 10:38  sudo chmod 777 blacklist-nouveau.conf
  526  27.10.2019 10:39  ls -l
  527  27.10.2019 10:39  vi blacklist-nouveau.conf
  528  27.10.2019 10:40  sudo dracut --force
  529  27.10.2019 10:40  cd ~
  530  27.10.2019 10:40  sudo dracut --force
  531  27.10.2019 10:41  sudo update-initramfs -u
  532  27.10.2019 10:41  ls | grep nvidia
  533  27.10.2019 10:41  lspci | grep -i nvidia
  534  27.10.2019 10:41  lsmod | grep nvidia
  535  27.10.2019 10:42  sudo reboot
  536  27.10.2019 10:47  nvidia-smi
  537  27.10.2019 10:47  sudo init 3
  538  27.10.2019 11:03  nvidia-smi
  539  27.10.2019 11:03  sudo update-initramfs -u
  540  27.10.2019 11:03  nvidia-smi
  541  27.10.2019 11:04  lsmod | grep nvidia
  542  27.10.2019 11:04  cd /etc/default
  543  27.10.2019 11:04  ls
  544  27.10.2019 11:04  sudo gedit grub
  545  27.10.2019 11:06  sudo init 3
  546  27.10.2019 11:06  nvidia-smi
  547  27.10.2019 11:07  lsmod | grep nvidia
  548  27.10.2019 11:09  sudo gedit grub
  549  27.10.2019 11:23  sudo nano grub
  550  27.10.2019 11:44  reboot
  551  27.10.2019 11:46  init 3
  552  27.10.2019 11:46  sudo init 3
  553  27.10.2019 11:47  nvidia-smi
  554  27.10.2019 11:47  lsmod | grep nvidia
  555  27.10.2019 11:47  sudo update-initramfs -u
  556  27.10.2019 16:14  vi .zshrc
  557  27.10.2019 16:15  source .zshrc
  558  27.10.2019 16:15  sudo update-initramfs -u
  559  27.10.2019 16:16  lsmod | grep nvidia
  560  27.10.2019 16:16  reboot
  561  27.10.2019 16:18  sudo init 3
  562  28.10.2019 17:07  nvidia-smi
  563  28.10.2019 17:07  sudo update-initramfs -u
  564  28.10.2019 17:08  cat -n /etc/modprobe.d/blacklist-nouveau.conf
  565  28.10.2019 17:09  sudo sh cuda_9.0.176_384.81_linux-run
  566  28.10.2019 17:10  cat -n /var/log/nvidia-installer.log
  567  28.10.2019 17:12  sudo rmmod nvidia-modeset
  568  28.10.2019 17:13  sudo service lightdm stop
  569  28.10.2019 17:13  sudo stop nvidia-digits-server
  570  28.10.2019 17:13  sudo service docker stop
  571  28.10.2019 17:13  sudo rmmod nvidia-modeset
  572  28.10.2019 17:14  lsmod | grep nvidia
  573  28.10.2019 17:16  lsof | grep nvidia
  574  28.10.2019 17:17  su -
  575  28.10.2019 17:18  modprobe -r nvidia-modeset
  576  28.10.2019 17:18  lsmod | grep nvidia
  577  28.10.2019 17:20  reboot
  578  28.10.2019 17:20  sudo reboot
  579  28.10.2019 17:23  nvidia-smi
  580  28.10.2019 17:23  sudo init 3
  581  28.10.2019 17:23  nvidia-smi
  582  28.10.2019 17:23  lsmod | grep nvidia
  583  28.10.2019 17:25  sudo update-grub2
  584  28.10.2019 17:25  reboot
  585  28.10.2019 17:25  sudo reboot
  586  28.10.2019 17:27  sudo init 3
  587  28.10.2019 17:27  nvidia-smi
  588  28.10.2019 17:27  lsmod | grep nvidia
  589  28.10.2019 17:28  nano /etc/default/grub
  590  28.10.2019 17:29  exit
  591  28.10.2019 17:31  update-grub
  592  28.10.2019 17:31  sudo update-grub
  593  28.10.2019 17:31  reboot
  594  28.10.2019 17:34  nano /etc/default/grub
  595  28.10.2019 17:36  sudo nano /etc/default/grub
  596  28.10.2019 17:36  sudo update-grub
  597  28.10.2019 17:37  sudo update-grub2
  598  28.10.2019 17:37  reboot
  599  28.10.2019 17:40  su -
  600  28.10.2019 19:00  sudo apt update
  601  28.10.2019 19:01  apt list --upgradable
  602  28.10.2019 19:03  nvidia-smi
  603  28.10.2019 19:03  sudo init 3
  604  28.10.2019 19:03  nvidia-smi
  605  28.10.2019 19:04  lsmod | grep nvidia
  606  28.10.2019 19:07  sudo nano /etc/default/grub
  607  28.10.2019 19:07  reboot
  608  28.10.2019 19:09  sudo init 3
  609  28.10.2019 19:11  reboot
  610  28.10.2019 19:14  sudo init 3
  611  28.10.2019 19:14  lsmod | grep nvidia
  612  28.10.2019 19:15  cat -n /etc/X11/default-display-manager
  613  28.10.2019 19:16  vi -n /etc/X11/default-display-manager
  614  28.10.2019 19:16  cat -n /etc/X11/default-display-manager
  615  28.10.2019 19:17  sudo nano /etc/default/grub
  616  28.10.2019 19:18  sudo update-grub
  617  28.10.2019 19:18  sudo update-grub2
  618  28.10.2019 19:18  reboot
  619  28.10.2019 20:04  nvcc --version
  620  28.10.2019 20:06  nvidia-smi
  621  28.10.2019 20:09  sudo apt-get install cuda-toolkit-9-0
  622  28.10.2019 20:09  sudo apt-get install cudatoolkit-9-0
  623  28.10.2019 20:19  cat -n /etc/X11/default-display-manager
  624  28.10.2019 20:21  nvidia-smi
  625  28.10.2019 20:23  cat -n /etc/X11/default-display-manager
  626  28.10.2019 20:24  cat -n /etc/lightdm/lightdm.conf
  627  28.10.2019 20:24  ls /etc/lightdm
  628  28.10.2019 20:24  cat -n /etc/lightdm/lightdm.conf.d
  629  28.10.2019 20:25  cat -n /etc/lightdm/users.conf
  630  28.10.2019 20:26  ps cax | grep display-manager
  631  28.10.2019 20:27  ps cax | grep lightdm
  632  28.10.2019 21:03  sudo apt-get install -f
  633  28.10.2019 21:03  nvcc --version
  634  28.10.2019 21:03  reboot
  635  28.10.2019 21:13  sudo init 3
  636  28.10.2019 21:13  nvidia-smi
  637  28.10.2019 21:14  sudo init 3
  638  28.10.2019 21:14  nvidia-smi
  639  28.10.2019 21:14  reboot
  640  28.10.2019 21:21  sudo nano /etc/default/grub
  641  28.10.2019 21:21  reboot
  642  28.10.2019 21:23  sudo nano /etc/default/grub
  643  28.10.2019 21:23  sudo update-grub
  644  28.10.2019 21:23  sudo update-grub2
  645  28.10.2019 21:23  reboot
  646  28.10.2019 21:27  sudo nano /etc/default/grub
  647  28.10.2019 21:28  sudo update-grub
  648  28.10.2019 21:28  sudo update-grub2
  649  28.10.2019 21:28  reboot
  650  28.10.2019 21:30  vi /etc/modprobe.d/blacklist-nouveau.conf
  651  28.10.2019 21:30  sudo update-initramfs -u
  652  28.10.2019 21:32  rm /etc/mdadm/mdadm.conf
  653  28.10.2019 21:32  ls /etc/mdadm
  654  28.10.2019 21:32  sudo rm /etc/mdadm/mdadm.conf
  655  28.10.2019 21:32  ls /etc/mdadm
  656  28.10.2019 21:33  sudo update-initramfs -u
  657  28.10.2019 21:33  reboot
  658  28.10.2019 21:36  sudo nano /etc/default/grub
  659  28.10.2019 21:38  sudo update-grub
  660  28.10.2019 21:38  sudo update-grub2
  661  28.10.2019 21:38  reboot
  662  28.10.2019 21:40  nvidia-smi
  663  28.10.2019 21:40  lsmod | grep nvidia
  664  28.10.2019 21:41  sudo sh cuda_9.0.176_384.81_linux-run
  665  28.10.2019 21:44  locate cuda
  666  28.10.2019 21:44  locate cuda | grep /cuda$
  667  28.10.2019 22:12  sudo apt-get remove nvidia-cuda-toolkit
  668  28.10.2019 22:12  sudo apt-get -f install
  669  28.10.2019 22:13  nvcc --version
  670  28.10.2019 22:13  sudo apt-get install cuda-toolkit-9-0
  671  28.10.2019 22:16  sudo apt install cuda-9-0
  672  28.10.2019 22:17  cd /usr/local
  673  28.10.2019 22:17  ls
  674  28.10.2019 22:17  cd cuda
  675  28.10.2019 22:17  ls
  676  28.10.2019 22:17  cd bin
  677  28.10.2019 22:17  ls
  678  28.10.2019 22:17  nvcc --version
  679  28.10.2019 22:17  cd ..
  680  28.10.2019 22:18  ls
  681  28.10.2019 22:18  cd cuda-9.0
  682  28.10.2019 22:18  ls
  683  28.10.2019 22:18  cd bin
  684  28.10.2019 22:18  ls
  685  28.10.2019 22:18  nvcc --version
  686  28.10.2019 22:18  ./uninstall_cuda_9.0.pl
  687  28.10.2019 22:18  sudo ./uninstall_cuda_9.0.pl
  688  28.10.2019 22:20  lsmod | grep nvidia
  689  28.10.2019 22:24  nvidia-smi
  690  28.10.2019 22:24  lsmod | grep nvidia
  691  28.10.2019 22:26  ps a | grep X
  692  28.10.2019 22:27  sudo modprobe -r nvidia
  693  28.10.2019 22:27  lsmod | grep nvidia
  694  28.10.2019 22:56  sudo nano /etc/default/grub
  695  28.10.2019 22:56  reboot
  696  28.10.2019 22:56  sudo reboot
  697  29.10.2019 09:39  exit
  698  29.10.2019 09:41  sudo reboot
  699  29.10.2019 09:41  sudo nano /etc/default/grub
  700  29.10.2019 09:42  sudo update-grub2
  701  29.10.2019 09:42  sudo update-grub
  702  29.10.2019 09:42  sudo reboot
  703  29.10.2019 09:44  ssh g
  704  29.10.2019 09:44  nvidia-smi
  705  29.10.2019 09:44  sudo nano /etc/default/grub
  706  29.10.2019 09:44  sudo reboot
  707  29.10.2019 09:46  sudo nano /etc/default/grub
  708  29.10.2019 09:46  sudo update-grub
  709  29.10.2019 09:46  sudo update-grub2
  710  29.10.2019 09:47  sudo reboot
  711  29.10.2019 09:49  cat -n /etc/init/lightdm.conf
  712  29.10.2019 09:52  vi /etc/init/lightdm.conf
  713  29.10.2019 09:57  cat -n /etc/init/rc-sysinit.conf
  714  29.10.2019 09:57  vi -n /etc/init/rc-sysinit.conf
  715  29.10.2019 09:58  sudo vi -n /etc/init/rc-sysinit.conf
  716  29.10.2019 09:59  sudo nano /etc/default/grub
  717  29.10.2019 10:00  sudo update-grub
  718  29.10.2019 10:00  sudo update-grub2
  719  29.10.2019 10:00  reboot
  720  29.10.2019 10:51  sudo nano /etc/default/grub
  721  29.10.2019 10:52  reboot
  722  29.10.2019 10:52  sudo update-grub
  723  29.10.2019 10:52  sudo update-grub2
  724  29.10.2019 10:52  reboot
  725  29.10.2019 10:52  sudo reboot
  726  29.10.2019 10:55  echo $RUNLEVEL
  727  29.10.2019 10:55  runlevel
  728  29.10.2019 10:56  who -r
  729  29.10.2019 10:58  cat -n /etc/init/rc-sysinit.conf
  730  29.10.2019 11:00  cat -n /etc/systemd/system/default.target
  731  29.10.2019 11:04  cat -n /boot/grub/grub.cfg
  732  29.10.2019 11:07  nvidia-smi
  733  29.10.2019 11:08  vi /etc/init/rc-sysinit.conf
  734  29.10.2019 11:10  systemctl set-default
  735  29.10.2019 11:10  systemctl
  736  29.10.2019 11:13  sudo telinit 3
  737  29.10.2019 11:13  runlevel
  738  29.10.2019 11:15  cd /sbin/
  739  29.10.2019 11:15  ls
  740  29.10.2019 11:15  cd init
  741  29.10.2019 11:15  cat -n init
  742  29.10.2019 11:15  cat -n telinit
  743  29.10.2019 11:17  runlevel
  744  29.10.2019 11:17  where runlevel
  745  29.10.2019 11:17  cat -n /sbin/runlevel
  746  29.10.2019 11:17  vi /sbin/runlevel
  747  29.10.2019 11:18  reboot
  748  29.10.2019 11:18  sudo reboot
  749  29.10.2019 11:19  runlevel
  750  29.10.2019 11:19  sudo telinit 3
  751  29.10.2019 11:20  runlevel
  752  29.10.2019 11:20  sudo telinit 5
  753  29.10.2019 11:20  runlevel
  754  29.10.2019 11:20  sudo telinit 3
  755  29.10.2019 11:20  sudo telinit N
  756  29.10.2019 11:20  runlevel
  757  29.10.2019 11:20  sudo telinit 3
  758  29.10.2019 11:20  runlevel
  759  29.10.2019 11:22  reboot
  760  29.10.2019 11:22  sudo reboot
  761  29.10.2019 11:25  nvidia-smi
  762  29.10.2019 11:25  runlevel
  763  29.10.2019 11:26  sudo sh cuda_9.0.176_384.81_linux-run
  764  29.10.2019 11:27  cat -n /var/log/nvidia-installer.log
  765  29.10.2019 11:29  sudo service lightdm stop
  766  29.10.2019 11:29  sudo stop nvidia-digits-server
  767  29.10.2019 11:31  sudo service docker stop
  768  29.10.2019 11:31  sudo rmmod nvidia-uvm
  769  29.10.2019 11:31  service nvidia-docker stop
  770  29.10.2019 11:31  sudo rmmod nvidia-uvm
  771  29.10.2019 11:31  lsmod | grep nvidia
  772  29.10.2019 11:32  sudo sh cuda_9.0.176_384.81_linux-run
  773  29.10.2019 11:33  cat -n /var/log/nvidia-installer.log
  774  29.10.2019 11:33  sudo sh cuda_9.0.176_384.81_linux-run
  775  29.10.2019 11:35  nvcc --version
  776  29.10.2019 11:38  sudo sh cuda_9.0.176_384.81_linux-run
  777  29.10.2019 11:44  vi .zshrc
  778  29.10.2019 11:45  where cuda
  779  29.10.2019 11:45  cd /usr/local
  780  29.10.2019 11:45  ls
  781  29.10.2019 11:48  cd cuda-9.0
  782  29.10.2019 11:48  ls
  783  29.10.2019 11:49  source .zshrc
  784  29.10.2019 11:49  nvcc --version
  785  29.10.2019 14:09  python --version
  786  29.10.2019 14:10  pip list
  787  29.10.2019 14:11  cd /
  788  29.10.2019 14:11  ls
  789  29.10.2019 14:11  cd home
  790  29.10.2019 14:11  cd Kong
  791  29.10.2019 14:11  ls
  792  29.10.2019 14:12  cd /usr/local
  793  29.10.2019 14:12  ls
  794  29.10.2019 14:12  cd cuda-9.0
  795  29.10.2019 14:12  ls
  796  29.10.2019 14:12  cd samples
  797  29.10.2019 14:12  ls
  798  29.10.2019 14:13  make
  799  29.10.2019 14:13  cd /home/Kong
  800  29.10.2019 14:13  ls
  801  29.10.2019 14:13  cd CUDA
  802  29.10.2019 14:13  ls
  803  29.10.2019 14:14  make
  804  29.10.2019 14:14  source ~/.zshrc
  805  29.10.2019 14:14  make
  806  29.10.2019 14:14  cd
  807  29.10.2019 14:14  cd /usr/local
  808  29.10.2019 14:14  ls
  809  29.10.2019 14:14  cd cuda-9.0
  810  29.10.2019 14:14  ls
  811  29.10.2019 14:14  cd samples/
  812  29.10.2019 14:14  ls
  813  29.10.2019 14:15  cd 5_Simulations
  814  29.10.2019 14:15  ls
  815  29.10.2019 14:15  make
  816  29.10.2019 14:15  cd nbody
  817  29.10.2019 14:15  ls
  818  29.10.2019 14:15  make
  819  29.10.2019 14:15  nvcc --version
  820  29.10.2019 14:15  reboot
  821  29.10.2019 14:15  sudo reboot
  822  29.10.2019 14:17  sudo nano /etc/default/grub
  823  29.10.2019 14:18  sudo vi -n /etc/init/rc-sysinit.conf
  824  29.10.2019 14:18  sudo update-grub
  825  29.10.2019 14:18  sudo update-grub2
  826  29.10.2019 14:18  reboot
  827  29.10.2019 14:18  sudo reboot
  828  29.10.2019 14:20  cd /usr/local/cuda-9.0/samples
  829  29.10.2019 14:20  ls
  830  29.10.2019 14:20  cd 0_Simple
  831  29.10.2019 14:20  ls
  832  29.10.2019 14:20  cd clock
  833  29.10.2019 14:20  ls
  834  29.10.2019 14:20  make
  835  29.10.2019 14:22  /usr/local/cuda/bin/nvcc
  836  29.10.2019 14:22  /usr/local/cuda/bin/nvcc --version
  837  29.10.2019 14:24  cd /etc/modprobe.d
  838  29.10.2019 14:24  ls
  839  29.10.2019 14:25  sudo rm blacklist-nouveau.conf
  840  29.10.2019 14:25  sudo update-initramfs -u
  841  29.10.2019 14:25  sudo reboot
  842  29.10.2019 14:27  cd /usr/local/cuda-9.0/samples
  843  29.10.2019 14:27  ls
  844  29.10.2019 14:27  cd 0_Simple
  845  29.10.2019 14:27  ls
  846  29.10.2019 14:27  cd clock
  847  29.10.2019 14:27  ls
  848  29.10.2019 14:27  make
  849  29.10.2019 14:29  nvidia-smi
  850  29.10.2019 14:31  echo $LD_LIBRARY_PATH
  851  29.10.2019 14:32  uname -rm x86-64
  852  29.10.2019 14:32  uname -rm x86_64
  853  29.10.2019 14:32  uname -r
  854  29.10.2019 14:33  cd /usr/lib/nvidia-384
  855  29.10.2019 14:33  ls
  856  29.10.2019 14:36  cd /usr/local/cuda-9.0
  857  29.10.2019 14:36  ls
  858  29.10.2019 14:36  cd bin
  859  29.10.2019 14:36  ls
  860  29.10.2019 14:37  cd ..
  861  29.10.2019 14:37  ls
  862  29.10.2019 14:37  nvidia-detector
  863  29.10.2019 14:37  lspci | grep -i vga
  864  29.10.2019 14:38  ls
  865  29.10.2019 14:38  cd samples
  866  29.10.2019 14:38  ls
  867  29.10.2019 14:38  cd 0_Simple
  868  29.10.2019 14:38  ls
  869  29.10.2019 14:38  cd ..
  870  29.10.2019 14:38  cd  7_CUDALibraries
  871  29.10.2019 14:38  ls
  872  29.10.2019 14:39  cd ..
  873  29.10.2019 14:39  sl
  874  29.10.2019 14:39  ls
  875  29.10.2019 14:39  cd 5_Simulations
  876  29.10.2019 14:39  ls
  877  29.10.2019 14:39  cd nbody
  878  29.10.2019 14:39  sudo make
  879  29.10.2019 14:39  echo $PATH
  880  29.10.2019 14:40  vi ~/.zshrc
  881  29.10.2019 14:40  source ~/.zshrc
  882  29.10.2019 14:40  make
  883  29.10.2019 14:40  exit
  884  29.10.2019 14:41  cd /usr/local/cuda-9.0/samples
  885  29.10.2019 14:41  ls
  886  29.10.2019 14:41  cd 5_Simulations
  887  29.10.2019 14:41  ls
  888  29.10.2019 14:41  cd nbody
  889  29.10.2019 14:41  ls
  890  29.10.2019 14:41  make
  891  29.10.2019 14:41  vi ~/.zshrc
  892  29.10.2019 14:42  exit
  893  29.10.2019 14:42  cd /usr/local/cuda-9.0
  894  29.10.2019 14:42  cd samples
  895  29.10.2019 14:42  ls
  896  29.10.2019 14:42  cd 5_Simulations
  897  29.10.2019 14:42  ls
  898  29.10.2019 14:42  cd ..
  899  29.10.2019 14:42  ls
  900  29.10.2019 14:42  cd 0_Simple
  901  29.10.2019 14:42  ls
  902  29.10.2019 14:43  cd clock
  903  29.10.2019 14:43  make
  904  29.10.2019 14:43  echo $PATH
  905  29.10.2019 14:44  cd /usr/local/cuda-9.0/bin
  906  29.10.2019 14:44  ls
  907  29.10.2019 14:44  ./nvcc --version
  908  29.10.2019 14:44  nvcc --version
  909  29.10.2019 14:44  vi ~/.zshrc
  910  29.10.2019 14:45  exit
  911  29.10.2019 14:46  cd /usr/local/cuda-9.0/samples
  912  29.10.2019 14:46  cd 0_Simple
  913  29.10.2019 14:46  ls
  914  29.10.2019 14:46  cd clock
  915  29.10.2019 14:46  make
  916  29.10.2019 14:46  vi ~/.zshrc
  917  29.10.2019 14:46  echo $LD_LIBRARY_PATH
  918  29.10.2019 14:46  vi ~/.zshrc
  919  29.10.2019 14:47  source ~/.zshrc
  920  29.10.2019 14:47  echo $LD_LIBRARY_PATH
  921  29.10.2019 14:48  pwd
  922  29.10.2019 14:48  cd ..
  923  29.10.2019 14:48  ls
  924  29.10.2019 14:48  cd ..
  925  29.10.2019 14:48  ls
  926  29.10.2019 14:48  cd ..
  927  29.10.2019 14:48  ls
  928  29.10.2019 14:48  cd lib64
  929  29.10.2019 14:48  ls
  930  29.10.2019 14:49  cd /usr/local/cuda-9.0/samples
  931  29.10.2019 14:49  cd 0_Simple
  932  29.10.2019 14:49  ls
  933  29.10.2019 14:49  cd simpleAssert
  934  29.10.2019 14:49  make
  935  29.10.2019 14:50  vi Makefile
  936  29.10.2019 14:51  cd /usr/local/cuda-9.0/
  937  29.10.2019 14:51  ls
  938  29.10.2019 14:51  cd samples
  939  29.10.2019 14:51  ls
  940  29.10.2019 14:51  cd 0_Simple
  941  29.10.2019 14:51  ls
  942  29.10.2019 14:51  cd clock
  943  29.10.2019 14:51  vi Makefile
  944  29.10.2019 14:52  vi ~/.zshrc
  945  29.10.2019 14:54  vi ~/.bashrc
  946  29.10.2019 15:01  cd ../samples
  947  29.10.2019 15:01  cd 3_Imaging
  948  29.10.2019 15:01  ls
  949  29.10.2019 15:01  cd cudaDecodeGL
  950  29.10.2019 15:01  ls
  951  29.10.2019 15:01  ./findgllib.mk
  952  29.10.2019 15:01  sudo ./findgllib.mk
  953  29.10.2019 15:01  cat -n findgllib.mk
  954  29.10.2019 15:04  lsmod | grep nouveau
  955  29.10.2019 15:04  sudo update-initramfs -u
  956  29.10.2019 15:04  sudo reboot
  957  29.10.2019 15:06  cd /usr/local/cuda-9.0/samples
  958  29.10.2019 15:06  cd
  959  29.10.2019 15:06  lsmod | grep nouveau
  960  29.10.2019 15:11  cd ~/NVIDIA_CUDA-9.0_Samples
  961  29.10.2019 15:11  ls
  962  29.10.2019 15:11  cd 0_Simple
  963  29.10.2019 15:11  ls
  964  29.10.2019 15:11  cd clock
  965  29.10.2019 15:11  ls
  966  29.10.2019 15:11  make
  967  29.10.2019 15:12  cd /usr/local/cuda
  968  29.10.2019 15:12  ls
  969  29.10.2019 15:16  ls /etc/modprobe.d
  970  29.10.2019 15:17  cd /dev/
  971  29.10.2019 15:17  ls
  972  29.10.2019 15:20  cat -n nvidia0
  973  29.10.2019 15:21  cat -n nvidia1
  974  29.10.2019 15:21  vi nvidia0
  975  29.10.2019 15:21  ls | grep nvidia
  976  29.10.2019 15:21  vi nvidia-modeset
  977  29.10.2019 15:21  vi nvidia-uvm
  978  29.10.2019 15:21  vi nvidia-uvm-tools
  979  29.10.2019 15:22  vi nvidiactl
  980  29.10.2019 15:24  vi ~/.zshrc
  981  29.10.2019 15:26  ls -l
  982  29.10.2019 15:26  ls -l | grep nvidai
  983  29.10.2019 15:26  ls -l | grep nvidia
  984  29.10.2019 15:28  cd /usr/local/cuda-9.0/samples/0_Simple/clock
  985  29.10.2019 15:28  ls
  986  29.10.2019 15:28  vi clock.cu
  987  29.10.2019 15:31  make
  988  29.10.2019 15:33  cd ../../3_Imaging/cudaDecodeGL
  989  29.10.2019 15:33  vi findgllib.mk
  990  29.10.2019 15:35  sudo gedit /etc/environment
  991  29.10.2019 15:35  sudo nano /etc/environment
  992  29.10.2019 15:36  vi ~/.zshrc
  993  29.10.2019 15:36  echo $PATH
  994  29.10.2019 15:37  vi ~/.zshrc
  995  29.10.2019 15:37  source ~/.zshrc
  996  29.10.2019 15:37  echo $PATH
  997  29.10.2019 15:38  vi ~/.zshrc
  998  29.10.2019 15:38  source ~/.zshrc
  999  29.10.2019 15:38  echo $PATH
 1000  29.10.2019 15:39  exit
 1001  29.10.2019 15:39  echo $PATH
 1002  29.10.2019 15:39  vi ~/.zshrc
 1003  29.10.2019 15:39  exit
 1004  29.10.2019 15:39  echo $PATH
 1005  29.10.2019 15:40  sudo reboot
 1006  29.10.2019 15:43  sudo nano /etc/environment
 1007  29.10.2019 15:43  echo $LD_LIBRARY_PATH
 1008  29.10.2019 15:44  sudo reboot
 1009  29.10.2019 15:47  cd /home/Kong/CUDA
 1010  29.10.2019 15:47  ls
 1011  29.10.2019 15:47  cd ..
 1012  29.10.2019 15:47  ls
 1013  29.10.2019 15:47  cd NVIDIA_CUDA-9.0_Samples
 1014  29.10.2019 15:47  ls
 1015  29.10.2019 15:47  cd 3_Imaging
 1016  29.10.2019 15:47  ls
 1017  29.10.2019 15:47  cd ../0_Simple
 1018  29.10.2019 15:47  ls
 1019  29.10.2019 15:48  cd simpleAssert
 1020  29.10.2019 15:48  make
 1021  29.10.2019 15:50  cat -n /proc/driver/nvidia/version
 1022  29.10.2019 15:57  cd ../../1_Utilities
 1023  29.10.2019 15:57  ls
 1024  29.10.2019 15:57  cd deviceQuery
 1025  29.10.2019 15:57  ls
 1026  29.10.2019 15:57  make
 1027  29.10.2019 15:58  ls
 1028  29.10.2019 15:58  vi deviceQuery.cpp
 1029  29.10.2019 15:58  find cuda_runtime.h
 1030  29.10.2019 15:58  find / -name cuda_runtime.h
 1031  29.10.2019 15:59  sudo find / -name cuda_runtime.h
 1032  29.10.2019 15:59  sudo find / -name helper_cuda.h
 1033  29.10.2019 16:03  sudo find / -name iostream
 1034  29.10.2019 16:03  sudo find / -name memory
 1035  29.10.2019 16:06  sudo make
 1036  29.10.2019 16:10  sudo find / -name helper_cuda.h
 1037  29.10.2019 16:11  pwd
 1038  29.10.2019 16:11  cd /home/Kong/NVIDIA_CUDA-9.0_Samples/common/inc
 1039  29.10.2019 16:11  ls
 1040  29.10.2019 16:11  vi helper_cuda.h
 1041  29.10.2019 16:23  echo $PATH
 1042  29.10.2019 16:23  ssh s
 1043  29.10.2019 16:25  gcc --version
 1044  29.10.2019 16:25  g++ --version
 1045  29.10.2019 16:26  make
 1046  29.10.2019 16:32  echo $PATH
 1047  29.10.2019 16:32  echo $LD_LIBRARY_PATH
 1048  29.10.2019 16:32  vi ~/.bashrc
 1049  29.10.2019 16:34  ls
 1050  29.10.2019 16:35  cd ../../0_Simple
 1051  29.10.2019 16:35  ls
 1052  29.10.2019 16:35  cd cloak
 1053  29.10.2019 16:35  cd clock
 1054  29.10.2019 16:35  ls
 1055  29.10.2019 16:35  make
 1056  29.10.2019 16:40  lspci | grep -i nvidia
 1057  29.10.2019 16:40  uname -m && cat /etc/*release
 1058  29.10.2019 16:42  uname -r
 1059  29.10.2019 16:43  sudo apt-get install linux-headers-$(uname -r)
 1060  29.10.2019 16:44  cd /usr/bin/
 1061  29.10.2019 16:44  ls
 1062  29.10.2019 16:44  ls | grep nvidia
 1063  29.10.2019 16:45  nvidia-smi
 1064  29.10.2019 16:50  make
 1065  29.10.2019 18:14  nvcc --version
 1066  29.10.2019 18:14  nvcc -V
 1067  29.10.2019 18:21  cd /home/Kong/NVIDIA_CUDA-9.0_Samples/1_Utilities
 1068  29.10.2019 18:21  ls
 1069  29.10.2019 18:21  cd deviceQuery
 1070  29.10.2019 18:31  cd ..
 1071  29.10.2019 18:31  make
 1072  29.10.2019 18:44  ls
 1073  29.10.2019 18:44  cd 1_Utilities/deviceQuery
 1074  29.10.2019 18:44  ls
 1075  29.10.2019 18:47  uname -m
 1076  29.10.2019 18:48  cd ../../3_Imaging/cudaDecodeGL
 1077  29.10.2019 18:48  ls
 1078  29.10.2019 18:48  vi findgllib.mk
 1079  29.10.2019 18:55  cat /proc/driver/nvidia/version
 1080  29.10.2019 18:56  pwd
 1081  29.10.2019 18:57  cd ../../1_Utilities/deviceQuery
 1082  29.10.2019 18:57  pwd
 1083  29.10.2019 18:57  ls
 1084  29.10.2019 18:58  make
 1085  29.10.2019 19:02  cat -n ~/.zshrc | tail -4
 1086  29.10.2019 19:03  cat -n ~/.zshrc | tail -5
 1087  29.10.2019 19:03  cat -n ~/.zshrc | tail -6
 1088  29.10.2019 19:06  echo $PATH
 1089  29.10.2019 19:06  exit
 1090  29.10.2019 19:06  echo $PATH
 1091  29.10.2019 19:06  vi .zshrc
 1092  29.10.2019 19:08  echo $LD_LIBRARY_PATH
 1093  29.10.2019 22:25  cd
 1094  29.10.2019 22:25  which nvcc
 1095  29.10.2019 22:25  /usr/local/cuda-9.0/bin/nvcc --version
 1096  29.10.2019 23:23  grep cudaErrorNvlink /usr/local/cuda-9.0/include/*.h
 1097  30.10.2019 00:00  cd /home/Kong/NVIDIA_CUDA-9.0_Samples/1_Utilities/deviceQuery/
 1098  30.10.2019 00:00  /usr/local/cuda-9.0/bin/nvcc --verbose -ccbin g++ -I../../common/inc -m64 -gencode arch=compute_30,code=sm_30 -o deviceQuery.o -c deviceQuery.cpp
 1099  30.10.2019 00:24  grep cudaErrorNvlink /usr/local/cuda-9.0/targets/x86_64-linux/include
 1100  30.10.2019 00:33  grep cudaErrorNvlink /usr/local/cuda-9.0/targets/x86_64-linux/include/*.h
 1101  30.10.2019 08:25  exit

May be it is better to reinstall the whole DGX OS, it is ok for me since by now I have not done much setting on it.

I update the latest version by

$ sudo apt update
$ sudo apt -s full-upgrade
$ sudo apt -y full-upgrade

.

And I restart it. When I want to do “Make sure that is updated and working correctly first (compile and run CUDA samples using whatever version of CUDA is installed by the software update).” It goes wrong again to compile the file in /home/Kong/NVIDIA_CUDA-9.0_Samples/1_Utilities/deviceQuery, I have already change the Makefile " CUDA_PATH ?= “/usr” " since the path where the nvcc exist is “/usr/bin/nvcc”

$ make
"/usr"/bin/nvcc -ccbin g++ -I../../common/inc  -m64    -gencode arch=compute_30,code=sm_30 -gencode arch=compute_35,code=sm_35 -gencode arch=compute_37,code=sm_37 -gencode arch=compute_50,code=sm_50 -gencode arch=compute_52,code=sm_52 -gencode arch=compute_60,code=sm_60 -gencode arch=compute_70,code=sm_70 -gencode arch=compute_70,code=compute_70 -o deviceQuery.o -c deviceQuery.cpp
nvcc fatal   : Unsupported gpu architecture 'compute_60'
Makefile:274: recipe for target 'deviceQuery.o' failed
make: *** [deviceQuery.o] Error 1