Error setting up TAO Toolkit - 'nvidia-docker not found'

I came across github issue discussing the same - Installing Error · Issue #6 · NVIDIA/tao_tutorials · GitHub. It is still in open state.

Hope this give some clues in troubleshooting this.

Hi, I can install tao launcher successfully in WSL ubuntu 22.04.
Step:

  1. I install fresh ubuntu22.04 in WSL under Windows11.
    Refer to https://linuxconfig.org/ubuntu-22-04-on-wsl-windows-subsystem-for-linux.
  2. Also install pip3 and unzip. You can refer to the log.
  3. Also add two lines as below in setup/quickstart_launcher.sh to fix “jupyter not found” which is a corner case in WSL.
       info "Installed jupyter"
       echo "export PATH=\"$(PATH):\$HOME/.local/bin\"" >> ~/.bashrc
       source ~/.bashrc
       jupyter --version | grep jupyter_core

Attach full log.
20250506_install_tao_launcher_in_wsl_ubuntu22_full.txt (374.8 KB)

Thank you for trying out in WSL and confirming it is working. Much appreciated.

I checked what all services are running and exited. I noticed that apparmor.service is in failed status. Could that be the reason?

  UNIT                                                  LOAD   ACTIVE SUB     DESCRIPTION                                                                  
  accounts-daemon.service                               loaded active running Accounts Service
  acpid.service                                         loaded active running ACPI event daemon
● apparmor.service                                      loaded failed failed  Load AppArmor profiles
  apport.service                                        loaded active exited  LSB: automatic crash report generation
  avahi-daemon.service                                  loaded active running Avahi mDNS/DNS-SD Stack
  blk-availability.service                              loaded active exited  Availability of block devices
  chrony.service                                        loaded active running chrony, an NTP client/server
  cloud-config.service                                  loaded active exited  Cloud-init: Config Stage
  cloud-final.service                                   loaded active exited  Cloud-init: Final Stage
  cloud-init-local.service                              loaded active exited  Cloud-init: Local Stage (pre-network)
  cloud-init.service                                    loaded active exited  Cloud-init: Network Stage
  colord.service                                        loaded active running Manage, Install and Generate Color Profiles
  console-setup.service                                 loaded active exited  Set console font and keymap
  containerd.service                                    loaded active running containerd container runtime
  cron.service                                          loaded active running Regular background program processing daemon
  cups-browsed.service                                  loaded active running Make remote CUPS printers available locally
  cups.service                                          loaded active running CUPS Scheduler
  dbus.service                                          loaded active running D-Bus System Message Bus
  docker.service                                        loaded active running Docker Application Container Engine
  ephemeral-disk-warning.service                        loaded active exited  Write warning to Azure ephemeral disk
  finalrd.service                                       loaded active exited  Create final runtime dir for shutdown pivot root
  gdm.service                                           loaded active running GNOME Display Manager
  hv-kvp-daemon.service                                 loaded active running Hyper-V KVP Protocol Daemon
  irqbalance.service                                    loaded active running irqbalance daemon
  kerneloops.service                                    loaded active running Tool to automatically collect and submit kernel crash signatures
  keyboard-setup.service                                loaded active exited  Set the console keyboard layout
  kmod-static-nodes.service                             loaded active exited  Create List of Static Device Nodes
  lvm2-monitor.service                                  loaded active exited  Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling
  ModemManager.service                                  loaded active running Modem Manager
  multipathd.service                                    loaded active running Device-Mapper Multipath Device Controller
  networkd-dispatcher.service                           loaded active running Dispatcher daemon for systemd-networkd
  NetworkManager-wait-online.service                    loaded active exited  Network Manager Wait Online
  NetworkManager.service                                loaded active running Network Manager
  nvidia-gridd.service                                  loaded active running NVIDIA Grid Daemon
  nvidia-persistenced.service                           loaded active running NVIDIA Persistence Daemon
  openvpn.service                                       loaded active exited  OpenVPN service
  packagekit.service                                    loaded active running PackageKit Daemon
  plymouth-quit-wait.service                            loaded active exited  Hold until boot process finishes up
  plymouth-read-write.service                           loaded active exited  Tell Plymouth To Write Out Runtime Data
  polkit.service                                        loaded active running Authorization Manager
  power-profiles-daemon.service                         loaded active running Power Profiles daemon
  rsyslog.service                                       loaded active running System Logging Service
  rtkit-daemon.service                                  loaded active running RealtimeKit Scheduling Policy Service
  serial-getty@ttyS0.service                            loaded active running Serial Getty on ttyS0
  setvtrgb.service                                      loaded active exited  Set console scheme
  snapd.apparmor.service                                loaded active exited  Load AppArmor profiles managed internally by snapd
  snapd.seeded.service                                  loaded active exited  Wait until snapd is fully seeded
  snapd.service                                         loaded active running Snap Daemon
  ssh.service                                           loaded active running OpenBSD Secure Shell server
  switcheroo-control.service                            loaded active running Switcheroo Control Proxy service
  sysstat.service                                       loaded active exited  Resets System Activity Logs
  systemd-binfmt.service                                loaded active exited  Set Up Additional Binary Formats
  systemd-fsck-root.service                             loaded active exited  File System Check on Root Device
  systemd-fsck@dev-disk-by\x2duuid-F3C9\x2d4183.service loaded active exited  File System Check on /dev/disk/by-uuid/F3C9-4183
  systemd-journal-flush.service                         loaded active exited  Flush Journal to Persistent Storage
  systemd-journald.service                              loaded active running Journal Service
  systemd-logind.service                                loaded active running User Login Management
  systemd-modules-load.service                          loaded active exited  Load Kernel Modules
  systemd-networkd-wait-online.service                  loaded active exited  Wait for Network to be Configured
  systemd-networkd.service                              loaded active running Network Configuration
  systemd-oomd.service                                  loaded active running Userspace Out-Of-Memory (OOM) Killer
  systemd-random-seed.service                           loaded active exited  Load/Save Random Seed
  systemd-remount-fs.service                            loaded active exited  Remount Root and Kernel File Systems
  systemd-resolved.service                              loaded active running Network Name Resolution
  systemd-sysctl.service                                loaded active exited  Apply Kernel Variables
  systemd-sysusers.service                              loaded active exited  Create System Users
  systemd-tmpfiles-setup-dev.service                    loaded active exited  Create Static Device Nodes in /dev
  systemd-tmpfiles-setup.service                        loaded active exited  Create Volatile Files and Directories
  systemd-udev-trigger.service                          loaded active exited  Coldplug All udev Devices
  systemd-udevd.service                                 loaded active running Rule-based Manager for Device Events and Files
  systemd-update-utmp.service                           loaded active exited  Record System Boot/Shutdown in UTMP
  systemd-user-sessions.service                         loaded active exited  Permit User Sessions
  udisks2.service                                       loaded active running Disk Manager
  ufw.service                                           loaded active exited  Uncomplicated firewall
  unattended-upgrades.service                           loaded active running Unattended Upgrades Shutdown
  upower.service                                        loaded active running Daemon for power management
  user-runtime-dir@1000.service                         loaded active exited  User Runtime Directory /run/user/1000
  user-runtime-dir@133.service                          loaded active exited  User Runtime Directory /run/user/133
  user@1000.service                                     loaded active running User Manager for UID 1000
  user@133.service                                      loaded active running User Manager for UID 133
  walinuxagent-network-setup.service                    loaded active exited  Setup network rules for WALinuxAgent
  walinuxagent.service                                  loaded active running Azure Linux Agent
  wpa_supplicant.service                                loaded active running WPA supplicant
  xrdp-sesman.service                                   loaded active running xrdp session manager
  xrdp.service                                          loaded active running xrdp daemon

LOAD   = Reflects whether the unit definition was properly loaded.
ACTIVE = The high-level unit activation state, i.e. generalization of SUB.
SUB    = The low-level unit activation state, values depend on unit type.
85 loaded units listed. Pass --all to see loaded but inactive units, too.
To show all installed unit files use 'systemctl list-unit-files'.
lines 39-92/92 (END)

Can you please check the status at your end too - systemctl list-units --type=service?

morganh@NV-2Z8YZ84:/mnt/c/Users/morganh$ systemctl list-units --type=service
  UNIT                                     LOAD   ACTIVE SUB     DESCRIPTION
  console-getty.service                    loaded active running Console Getty
  console-setup.service                    loaded active exited  Set console font and keymap
  cron.service                             loaded active running Regular background program processing daemon
  dbus.service                             loaded active running D-Bus System Message Bus
  getty@tty1.service                       loaded active running Getty on tty1
  keyboard-setup.service                   loaded active exited  Set the console keyboard layout
  rsyslog.service                          loaded active running System Logging Service
  setvtrgb.service                         loaded active exited  Set console scheme
  snapd.seeded.service                     loaded active exited  Wait until snapd is fully seeded
  snapd.service                            loaded active running Snap Daemon
  systemd-journal-flush.service            loaded active exited  Flush Journal to Persistent Storage
  systemd-journald.service                 loaded active running Journal Service
  systemd-logind.service                   loaded active running User Login Management
  systemd-modules-load.service             loaded active exited  Load Kernel Modules
  systemd-remount-fs.service               loaded active exited  Remount Root and Kernel File Systems
  systemd-resolved.service                 loaded active running Network Name Resolution
  systemd-sysctl.service                   loaded active exited  Apply Kernel Variables
  systemd-timedated.service                loaded active running Time & Date Service
  systemd-timesyncd.service                loaded active running Network Time Synchronization
  systemd-tmpfiles-setup-dev-early.service loaded active exited  Create Static Device Nodes in /dev gracefully
  systemd-tmpfiles-setup-dev.service       loaded active exited  Create Static Device Nodes in /dev
  systemd-tmpfiles-setup.service           loaded active exited  Create Volatile Files and Directories
  systemd-udev-trigger.service             loaded active exited  Coldplug All udev Devices
  systemd-udevd.service                    loaded active running Rule-based Manager for Device Events and Files
  systemd-update-utmp.service              loaded active exited  Record System Boot/Shutdown in UTMP
  systemd-user-sessions.service            loaded active exited  Permit User Sessions
  unattended-upgrades.service              loaded active running Unattended Upgrades Shutdown
  user-runtime-dir@1000.service            loaded active exited  User Runtime Directory /run/user/1000
  user@1000.service                        loaded active running User Manager for UID 1000
  wsl-pro.service                          loaded active running Bridge to Ubuntu Pro agent on Windows

Legend: LOAD   → Reflects whether the unit definition was properly loaded.
        ACTIVE → The high-level unit activation state, i.e. generalization of SUB.
        SUB    → The low-level unit activation state, values depend on unit type.

30 loaded units listed. Pass --all to see loaded but inactive units, too.
To show all installed unit files use 'systemctl list-unit-files'.

Thanks for the quick try out. Let me do a fresh install on WSL again. I will keep you posted.
Thank you for the detailed support. Highly appreciated.