CUDA so far behind. What gives!?

I am wanting to use the Isaac SDK (still many hoops to jump through) but…

Why in the world can’t you guys keep up? I am having issues with the Cuda version. My laptop is currently running Cuda 11.6 and my Workstation is running 11.6 also. We did manage at one point to install 10.2 on the workstation but it caused all kinds of mismatched issues and days worth of my payroll to get my employee to fix (restored back to 11.6).

Did you guys ever intend to be taken seriously? Why aren’t there any good write ups on how to take our drivers and cuda versions back to the stone age?

Back to you…

Coach

I just tried switching to 440 driver and now my computer won’t boot. I did this once before trying to meet your archaic requirements and same thing happened.

At this point I am just ready to walk away from nvidia. This is going to give me a heart attack.

I highly recommend tending to your health first and foremost. Isaac SDK 2021.1 is qualified against Jetpack 4.5 (OS+libraries supported on top of Ubuntu 18.04) which includes CUDA 10.2. You can install multiple CUDA versions on your desktop, however, and not downgrade your drivers (backwards compatible). See Installation Guide Linux :: CUDA Toolkit Documentation for maintaining multiple CUDA toolkit versions.

For those that run into the same problem I did (must be a rookie to accomplish):

Put Ubuntu into a recovery mode… Enable networking… purge any old nvidia drivers… reinstall latest drivers… reboot.

Now to try to understand @hemals theory of multiple Cuda versions on my desktop

Cheers,

Coach

Here is the output of the SDK install:

This is a helper script for installing dependencies to build the Isaac SDK.

First argument is the optional CUDA version. By default CUDA 10.2 dependent 
packages are installed. GPUs with Maxwell, Pascal, Volta and Turing  
architectures are supported in this configuration. Experimental support of 
newer architecture GPUs is available with the --config=x86_64_cuda_11_1 
option. 
 
CUDA 10.2 support was selected (default option).
Get:1 file:/var/cuda-repo-ubuntu1804-11-6-local  InRelease
Ign:1 file:/var/cuda-repo-ubuntu1804-11-6-local  InRelease
Get:2 file:/var/cudnn-local-repo-ubuntu1804-8.3.2.44  InRelease
Ign:2 file:/var/cudnn-local-repo-ubuntu1804-8.3.2.44  InRelease
Get:3 file:/var/cuda-repo-ubuntu1804-11-6-local  Release [564 B]
Get:4 file:/var/cudnn-local-repo-ubuntu1804-8.3.2.44  Release [564 B]
Get:3 file:/var/cuda-repo-ubuntu1804-11-6-local  Release [564 B]                                    
Get:4 file:/var/cudnn-local-repo-ubuntu1804-8.3.2.44  Release [564 B]                               
Hit:6 https://cli.github.com/packages stable InRelease                                              
Hit:7 http://packages.microsoft.com/repos/code stable InRelease                                     
Hit:9 http://us.archive.ubuntu.com/ubuntu bionic InRelease                                          
Hit:10 http://packages.ros.org/ros/ubuntu bionic InRelease                                          
Ign:11 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64  InRelease        
Hit:12 https://dl.google.com/linux/chrome/deb stable InRelease                                      
Get:13 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB]                        
Hit:14 https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64  Release          
Hit:15 http://us.archive.ubuntu.com/ubuntu bionic-updates InRelease                                 
Hit:16 http://ppa.launchpad.net/deadsnakes/ppa/ubuntu bionic InRelease                              
Get:17 http://us.archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB]                     
Hit:18 http://ppa.launchpad.net/graphics-drivers/ppa/ubuntu bionic InRelease                        
Fetched 163 kB in 1s (111 kB/s)                  
Traceback (most recent call last):
  File "/usr/lib/cnf-update-db", line 8, in <module>
    from CommandNotFound.db.creator import DbCreator
  File "/usr/lib/python3/dist-packages/CommandNotFound/db/creator.py", line 11, in <module>
    import apt_pkg
ModuleNotFoundError: No module named 'apt_pkg'
Reading package lists... Done
W: Skipping acquire of configured file 'Sources' as repository 'https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64  InRelease' does not seem to provide it (sources.list entry misspelt?)
E: Problem executing scripts APT::Update::Post-Invoke-Success 'if /usr/bin/test -w /var/lib/command-not-found/ -a -e /usr/lib/cnf-update-db; then /usr/lib/cnf-update-db > /dev/null; fi'
E: Sub-process returned an error code
[INFO] Installing packages - ffmpeg
[INFO] Successfully installed packages - ffmpeg
[INFO] Installing packages - lsb-core
[INFO] Successfully installed packages - lsb-core
[INFO] Installing packages - git git-lfs git-review build-essential g++ redis-server
[INFO] Successfully installed packages - git git-lfs git-review build-essential g++ redis-server
Error: Failed to call git rev-parse --git-dir --show-toplevel: "fatal: not a git repository (or any of the parent directories): .git\n"
Git LFS initialized.
[INFO] Installing packages - pkg-config zip zlib1g-dev unzip curl
[INFO] Successfully installed packages - pkg-config zip zlib1g-dev unzip curl
[INFO] Installing packages - uuid-dev
[INFO] Successfully installed packages - uuid-dev
[INFO] Installing packages - libx11-dev libxcursor-dev libxrandr-dev libxinerama-dev
[INFO] Successfully installed packages - libx11-dev libxcursor-dev libxrandr-dev libxinerama-dev
[INFO] Installing packages - sox
[INFO] Successfully installed packages - sox
[INFO] Installing packages - gcc-aarch64-linux-gnu g++-aarch64-linux-gnu
[INFO] Successfully installed packages - gcc-aarch64-linux-gnu g++-aarch64-linux-gnu
[INFO] Installing packages - libvpx5 libtwolame-dev libtheora-bin libspeex1
[INFO] Successfully installed packages - libvpx5 libtwolame-dev libtheora-bin libspeex1
[INFO] Installing packages - libopus0 libmp3lame0 libvdpau1 openexr libmpg123-0
[INFO] Successfully installed packages - libopus0 libmp3lame0 libvdpau1 openexr libmpg123-0
[INFO] Installing packages - python3-pip latexmk texlive-latex-recommended texlive-latex-extra texlive-fonts-recommended texlive-luatex texlive-xetex
[INFO] Successfully installed packages - python3-pip latexmk texlive-latex-recommended texlive-latex-extra texlive-fonts-recommended texlive-luatex texlive-xetex
[INFO] Installing packages - libudev-dev
[INFO] Successfully installed packages - libudev-dev
[INFO] Installing packages - libi2c-dev
[INFO] Successfully installed packages - libi2c-dev
[INFO] Installing packages - libhidapi-libusb0 libturbojpeg
[INFO] Successfully installed packages - libhidapi-libusb0 libturbojpeg
[INFO] Installing packages - python3-dev libssl-dev
[INFO] Successfully installed packages - python3-dev libssl-dev
[INFO] Installing packages - python3-tk libopenmpi-dev
[INFO] Successfully installed packages - python3-tk libopenmpi-dev
[INFO] Installing packages - glib2.0 gstreamer1.0-plugins.* libgstreamer1.0.* libgstreamer-plugins-.*1.0.*
[INFO] Successfully installed packages - glib2.0 gstreamer1.0-plugins.* libgstreamer1.0.* libgstreamer-plugins-.*1.0.*
[INFO] Installing packages - jq openssh-client
[INFO] Successfully installed packages - jq openssh-client
Collecting pip
  Downloading https://files.pythonhosted.org/packages/6a/df/a6ef77a6574781a668791419ffe366c8acd1c3cf4709d210cb53cd5ce1c2/pip-22.0.3-py3-none-any.whl (2.1MB)
    100% |████████████████████████████████| 2.1MB 99.1MB/s 
Installing collected packages: pip
Successfully installed pip-22.0.3
Requirement already satisfied: launchpadlib in /usr/lib/python3/dist-packages (1.10.6)
Requirement already satisfied: httplib2 in /usr/lib/python3/dist-packages (from launchpadlib) (0.9.2)
Requirement already satisfied: keyring in /usr/lib/python3/dist-packages (from launchpadlib) (10.6.0)
Requirement already satisfied: lazr.restfulclient>=0.9.19 in /usr/lib/python3/dist-packages (from launchpadlib) (0.13.5)
Requirement already satisfied: lazr.uri in /usr/lib/python3/dist-packages (from launchpadlib) (1.0.3)
Requirement already satisfied: setuptools in /usr/lib/python3/dist-packages (from launchpadlib) (39.0.1)
Collecting testresources
  Downloading testresources-2.0.1-py2.py3-none-any.whl (36 kB)
Requirement already satisfied: wadllib in /usr/lib/python3/dist-packages (from launchpadlib) (1.3.2)
Requirement already satisfied: secretstorage in /usr/lib/python3/dist-packages (from keyring->launchpadlib) (2.3.1)
Collecting pbr>=1.8
  Downloading pbr-5.8.1-py2.py3-none-any.whl (113 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 113.0/113.0 KB 9.3 MB/s eta 0:00:00
Installing collected packages: pbr, testresources
Successfully installed pbr-5.8.1 testresources-2.0.1
Requirement already satisfied: setuptools in /usr/lib/python3/dist-packages (39.0.1)
Collecting setuptools
  Downloading setuptools-60.8.1-py3-none-any.whl (1.1 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 8.3 MB/s eta 0:00:00
Installing collected packages: setuptools
Successfully installed setuptools-60.8.1
[INFO] Installing packages - protobuf-compiler
[INFO] Successfully installed packages - protobuf-compiler
Using pip 22.0.3 from /home/coach/.local/lib/python3.8/site-packages/pip (python 3.8)
ERROR: Invalid requirement: 'SDK/engine/engine/build/scripts/requirements.txt'
Hint: It looks like a path. File 'SDK/engine/engine/build/scripts/requirements.txt' does not exist.

I can’t tell if something failed.

# Custom Cuda Install
export PATH=/usr/local/cuda-10.2/bin${PATH:+:${PATH}}
export PATH=/usr/local/cuda-11.6/bin${PATH:+:${PATH}}

export LD_LIBRARY_PATH=/usr/local/cuda-10.2/lib64\
${LD_LIBRARY_PATH:+:${LD_LIBRARY_PATH}}

export LD_LIBRARY_PATH=/usr/local/cuda-11.6/lib64\
${LD_LIBRARY_PATH:+:${LD_LIBRARY_PATH}}


@hemals Is this going to be sufficient?

Can you tell us a bit more about your host system? What OS, what NVIDIA driver, what NVIDIA GPU you have installed? Any reproducible steps would help dig in a bit (what script were you running from where, etc.).