Ubuntu 20.04 installation nvidia Tao platform error

Please provide the following information when requesting support.

• Hardware :RTX 3070

I installed the nvidia tao platform according to this website information, and an error was reported when executing the following execution

$ nvidia-ctk --version
NVIDIA Container Toolkit CLI version 1.12.0
commit: 62bd015475656ef795cb0d59cc4030a6bd4a9526
$ sudo nvidia-ctk cdi generate --output=/etc/cdi/nvidia.yaml
WARN[0000] Failed to locate : pattern  not found        
INFO[0000] Selecting /dev/nvidia0 as /dev/nvidia0       
INFO[0000] Selecting /dev/dri/card0 as /dev/dri/card0   
INFO[0000] Selecting /dev/dri/renderD128 as /dev/dri/renderD128 
WARN[0000] Could not locate /var/run/nvidia-persistenced/socket: pattern /var/run/nvidia-persistenced/socket not found 
WARN[0000] Could not locate /var/run/nvidia-fabricmanager/socket: pattern /var/run/nvidia-fabricmanager/socket not found 
WARN[0000] Could not locate /tmp/nvidia-mps: pattern /tmp/nvidia-mps not found 
INFO[0000] Using driver version 525.89.02               
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/vdpau/libvdpau_nvidia.so.525.89.02 
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/libnvoptix.so.525.89.02 
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/libnvidia-wayland-client.so.525.89.02 
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/libnvidia-vulkan-producer.so.525.89.02 
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/libnvidia-tls.so.525.89.02 
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/libnvidia-rtcore.so.525.89.02 
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/libnvidia-ptxjitcompiler.so.525.89.02 
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/libnvidia-opticalflow.so.525.89.02 
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/libnvidia-opencl.so.525.89.02 
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/libnvidia-nvvm.so.525.89.02 
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/libnvidia-ngx.so.525.89.02 
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/libnvidia-ml.so.525.89.02 
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/libnvidia-gtk3.so.525.89.02 
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/libnvidia-gtk2.so.525.89.02 
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.525.89.02 
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.525.89.02 
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/libnvidia-glcore.so.525.89.02 
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/libnvidia-fbc.so.525.89.02 
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/libnvidia-encode.so.525.89.02 
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.525.89.02 
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/libnvidia-compiler.so.525.89.02 
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/libnvidia-cfg.so.525.89.02 
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.525.89.02 
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/libnvcuvid.so.525.89.02 
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/libcudadebugger.so.525.89.02 
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/libcuda.so.525.89.02 
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/libGLX_nvidia.so.525.89.02 
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/libGLESv2_nvidia.so.525.89.02 
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/libGLESv1_CM_nvidia.so.525.89.02 
INFO[0000] found 64-bit driver lib: /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.525.89.02 
INFO[0000] found 32-bit driver lib: /usr/lib/i386-linux-gnu/vdpau/libvdpau_nvidia.so.525.89.02 
INFO[0000] found 32-bit driver lib: /usr/lib/i386-linux-gnu/libnvidia-tls.so.525.89.02 
INFO[0000] found 32-bit driver lib: /usr/lib/i386-linux-gnu/libnvidia-ptxjitcompiler.so.525.89.02 
INFO[0000] found 32-bit driver lib: /usr/lib/i386-linux-gnu/libnvidia-opticalflow.so.525.89.02 
INFO[0000] found 32-bit driver lib: /usr/lib/i386-linux-gnu/libnvidia-opencl.so.525.89.02 
INFO[0000] found 32-bit driver lib: /usr/lib/i386-linux-gnu/libnvidia-nvvm.so.525.89.02 
INFO[0000] found 32-bit driver lib: /usr/lib/i386-linux-gnu/libnvidia-ml.so.525.89.02 
INFO[0000] found 32-bit driver lib: /usr/lib/i386-linux-gnu/libnvidia-glvkspirv.so.525.89.02 
INFO[0000] found 32-bit driver lib: /usr/lib/i386-linux-gnu/libnvidia-glsi.so.525.89.02 
INFO[0000] found 32-bit driver lib: /usr/lib/i386-linux-gnu/libnvidia-glcore.so.525.89.02 
INFO[0000] found 32-bit driver lib: /usr/lib/i386-linux-gnu/libnvidia-fbc.so.525.89.02 
INFO[0000] found 32-bit driver lib: /usr/lib/i386-linux-gnu/libnvidia-encode.so.525.89.02 
INFO[0000] found 32-bit driver lib: /usr/lib/i386-linux-gnu/libnvidia-eglcore.so.525.89.02 
INFO[0000] found 32-bit driver lib: /usr/lib/i386-linux-gnu/libnvidia-compiler.so.525.89.02 
INFO[0000] found 32-bit driver lib: /usr/lib/i386-linux-gnu/libnvidia-allocator.so.525.89.02 
INFO[0000] found 32-bit driver lib: /usr/lib/i386-linux-gnu/libnvcuvid.so.525.89.02 
INFO[0000] found 32-bit driver lib: /usr/lib/i386-linux-gnu/libcuda.so.525.89.02 
INFO[0000] found 32-bit driver lib: /usr/lib/i386-linux-gnu/libGLX_nvidia.so.525.89.02 
INFO[0000] found 32-bit driver lib: /usr/lib/i386-linux-gnu/libGLESv2_nvidia.so.525.89.02 
INFO[0000] found 32-bit driver lib: /usr/lib/i386-linux-gnu/libGLESv1_CM_nvidia.so.525.89.02 
INFO[0000] found 32-bit driver lib: /usr/lib/i386-linux-gnu/libEGL_nvidia.so.525.89.02 
INFO[0000] Selecting /dev/nvidia-modeset as /dev/nvidia-modeset 
WARN[0000] Could not locate /dev/nvidia-uvm-tools: pattern /dev/nvidia-uvm-tools not found 
WARN[0000] Could not locate /dev/nvidia-uvm: pattern /dev/nvidia-uvm not found 
INFO[0000] Selecting /dev/nvidiactl as /dev/nvidiactl   
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0 as /usr/lib/x86_64-linux-gnu/libnvidia-egl-gbm.so.1.1.0 
INFO[0000] Selecting /usr/share/glvnd/egl_vendor.d/10_nvidia.json as /usr/share/glvnd/egl_vendor.d/10_nvidia.json 
INFO[0000] Selecting /etc/vulkan/icd.d/nvidia_icd.json as /etc/vulkan/icd.d/nvidia_icd.json 
INFO[0000] Selecting /etc/vulkan/implicit_layer.d/nvidia_layers.json as /etc/vulkan/implicit_layer.d/nvidia_layers.json 
INFO[0000] Selecting /usr/share/egl/egl_external_platform.d/15_nvidia_gbm.json as /usr/share/egl/egl_external_platform.d/15_nvidia_gbm.json 
INFO[0000] Selecting /usr/share/egl/egl_external_platform.d/10_nvidia_wayland.json as /usr/share/egl/egl_external_platform.d/10_nvidia_wayland.json 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/vdpau/libvdpau_nvidia.so.525.89.02 as /usr/lib/x86_64-linux-gnu/vdpau/libvdpau_nvidia.so.525.89.02 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libnvoptix.so.525.89.02 as /usr/lib/x86_64-linux-gnu/libnvoptix.so.525.89.02 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libnvidia-wayland-client.so.525.89.02 as /usr/lib/x86_64-linux-gnu/libnvidia-wayland-client.so.525.89.02 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libnvidia-vulkan-producer.so.525.89.02 as /usr/lib/x86_64-linux-gnu/libnvidia-vulkan-producer.so.525.89.02 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libnvidia-tls.so.525.89.02 as /usr/lib/x86_64-linux-gnu/libnvidia-tls.so.525.89.02 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libnvidia-rtcore.so.525.89.02 as /usr/lib/x86_64-linux-gnu/libnvidia-rtcore.so.525.89.02 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libnvidia-ptxjitcompiler.so.525.89.02 as /usr/lib/x86_64-linux-gnu/libnvidia-ptxjitcompiler.so.525.89.02 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libnvidia-opticalflow.so.525.89.02 as /usr/lib/x86_64-linux-gnu/libnvidia-opticalflow.so.525.89.02 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libnvidia-opencl.so.525.89.02 as /usr/lib/x86_64-linux-gnu/libnvidia-opencl.so.525.89.02 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libnvidia-nvvm.so.525.89.02 as /usr/lib/x86_64-linux-gnu/libnvidia-nvvm.so.525.89.02 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libnvidia-ngx.so.525.89.02 as /usr/lib/x86_64-linux-gnu/libnvidia-ngx.so.525.89.02 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libnvidia-ml.so.525.89.02 as /usr/lib/x86_64-linux-gnu/libnvidia-ml.so.525.89.02 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libnvidia-gtk3.so.525.89.02 as /usr/lib/x86_64-linux-gnu/libnvidia-gtk3.so.525.89.02 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libnvidia-gtk2.so.525.89.02 as /usr/lib/x86_64-linux-gnu/libnvidia-gtk2.so.525.89.02 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.525.89.02 as /usr/lib/x86_64-linux-gnu/libnvidia-glvkspirv.so.525.89.02 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.525.89.02 as /usr/lib/x86_64-linux-gnu/libnvidia-glsi.so.525.89.02 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libnvidia-glcore.so.525.89.02 as /usr/lib/x86_64-linux-gnu/libnvidia-glcore.so.525.89.02 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libnvidia-fbc.so.525.89.02 as /usr/lib/x86_64-linux-gnu/libnvidia-fbc.so.525.89.02 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libnvidia-encode.so.525.89.02 as /usr/lib/x86_64-linux-gnu/libnvidia-encode.so.525.89.02 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.525.89.02 as /usr/lib/x86_64-linux-gnu/libnvidia-eglcore.so.525.89.02 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libnvidia-compiler.so.525.89.02 as /usr/lib/x86_64-linux-gnu/libnvidia-compiler.so.525.89.02 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libnvidia-cfg.so.525.89.02 as /usr/lib/x86_64-linux-gnu/libnvidia-cfg.so.525.89.02 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.525.89.02 as /usr/lib/x86_64-linux-gnu/libnvidia-allocator.so.525.89.02 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libnvcuvid.so.525.89.02 as /usr/lib/x86_64-linux-gnu/libnvcuvid.so.525.89.02 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libcudadebugger.so.525.89.02 as /usr/lib/x86_64-linux-gnu/libcudadebugger.so.525.89.02 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libcuda.so.525.89.02 as /usr/lib/x86_64-linux-gnu/libcuda.so.525.89.02 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libGLX_nvidia.so.525.89.02 as /usr/lib/x86_64-linux-gnu/libGLX_nvidia.so.525.89.02 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libGLESv2_nvidia.so.525.89.02 as /usr/lib/x86_64-linux-gnu/libGLESv2_nvidia.so.525.89.02 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libGLESv1_CM_nvidia.so.525.89.02 as /usr/lib/x86_64-linux-gnu/libGLESv1_CM_nvidia.so.525.89.02 
INFO[0000] Selecting /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.525.89.02 as /usr/lib/x86_64-linux-gnu/libEGL_nvidia.so.525.89.02 
INFO[0000] Selecting /usr/lib/i386-linux-gnu/vdpau/libvdpau_nvidia.so.525.89.02 as /usr/lib/i386-linux-gnu/vdpau/libvdpau_nvidia.so.525.89.02 
INFO[0000] Selecting /usr/lib/i386-linux-gnu/libnvidia-tls.so.525.89.02 as /usr/lib/i386-linux-gnu/libnvidia-tls.so.525.89.02 
INFO[0000] Selecting /usr/lib/i386-linux-gnu/libnvidia-ptxjitcompiler.so.525.89.02 as /usr/lib/i386-linux-gnu/libnvidia-ptxjitcompiler.so.525.89.02 
INFO[0000] Selecting /usr/lib/i386-linux-gnu/libnvidia-opticalflow.so.525.89.02 as /usr/lib/i386-linux-gnu/libnvidia-opticalflow.so.525.89.02 
INFO[0000] Selecting /usr/lib/i386-linux-gnu/libnvidia-opencl.so.525.89.02 as /usr/lib/i386-linux-gnu/libnvidia-opencl.so.525.89.02 
INFO[0000] Selecting /usr/lib/i386-linux-gnu/libnvidia-nvvm.so.525.89.02 as /usr/lib/i386-linux-gnu/libnvidia-nvvm.so.525.89.02 
INFO[0000] Selecting /usr/lib/i386-linux-gnu/libnvidia-ml.so.525.89.02 as /usr/lib/i386-linux-gnu/libnvidia-ml.so.525.89.02 
INFO[0000] Selecting /usr/lib/i386-linux-gnu/libnvidia-glvkspirv.so.525.89.02 as /usr/lib/i386-linux-gnu/libnvidia-glvkspirv.so.525.89.02 
INFO[0000] Selecting /usr/lib/i386-linux-gnu/libnvidia-glsi.so.525.89.02 as /usr/lib/i386-linux-gnu/libnvidia-glsi.so.525.89.02 
INFO[0000] Selecting /usr/lib/i386-linux-gnu/libnvidia-glcore.so.525.89.02 as /usr/lib/i386-linux-gnu/libnvidia-glcore.so.525.89.02 
INFO[0000] Selecting /usr/lib/i386-linux-gnu/libnvidia-fbc.so.525.89.02 as /usr/lib/i386-linux-gnu/libnvidia-fbc.so.525.89.02 
INFO[0000] Selecting /usr/lib/i386-linux-gnu/libnvidia-encode.so.525.89.02 as /usr/lib/i386-linux-gnu/libnvidia-encode.so.525.89.02 
INFO[0000] Selecting /usr/lib/i386-linux-gnu/libnvidia-eglcore.so.525.89.02 as /usr/lib/i386-linux-gnu/libnvidia-eglcore.so.525.89.02 
INFO[0000] Selecting /usr/lib/i386-linux-gnu/libnvidia-compiler.so.525.89.02 as /usr/lib/i386-linux-gnu/libnvidia-compiler.so.525.89.02 
INFO[0000] Selecting /usr/lib/i386-linux-gnu/libnvidia-allocator.so.525.89.02 as /usr/lib/i386-linux-gnu/libnvidia-allocator.so.525.89.02 
INFO[0000] Selecting /usr/lib/i386-linux-gnu/libnvcuvid.so.525.89.02 as /usr/lib/i386-linux-gnu/libnvcuvid.so.525.89.02 
INFO[0000] Selecting /usr/lib/i386-linux-gnu/libcuda.so.525.89.02 as /usr/lib/i386-linux-gnu/libcuda.so.525.89.02 
INFO[0000] Selecting /usr/lib/i386-linux-gnu/libGLX_nvidia.so.525.89.02 as /usr/lib/i386-linux-gnu/libGLX_nvidia.so.525.89.02 
INFO[0000] Selecting /usr/lib/i386-linux-gnu/libGLESv2_nvidia.so.525.89.02 as /usr/lib/i386-linux-gnu/libGLESv2_nvidia.so.525.89.02 
INFO[0000] Selecting /usr/lib/i386-linux-gnu/libGLESv1_CM_nvidia.so.525.89.02 as /usr/lib/i386-linux-gnu/libGLESv1_CM_nvidia.so.525.89.02 
INFO[0000] Selecting /usr/lib/i386-linux-gnu/libEGL_nvidia.so.525.89.02 as /usr/lib/i386-linux-gnu/libEGL_nvidia.so.525.89.02 
WARN[0000] Could not locate /lib/firmware/nvidia/525.89.02/gsp.bin: pattern /lib/firmware/nvidia/525.89.02/gsp.bin not found 
INFO[0000] Selecting /usr/bin/nvidia-smi as /usr/bin/nvidia-smi 
INFO[0000] Selecting /usr/bin/nvidia-debugdump as /usr/bin/nvidia-debugdump 
INFO[0000] Selecting /usr/bin/nvidia-persistenced as /usr/bin/nvidia-persistenced 
INFO[0000] Selecting /usr/bin/nvidia-cuda-mps-control as /usr/bin/nvidia-cuda-mps-control 
INFO[0000] Selecting /usr/bin/nvidia-cuda-mps-server as /usr/bin/nvidia-cuda-mps-server 
INFO[0000] Using minimum required CDI spec version: 0.5.0 
$ grep "  name:" /etc/cdi/nvidia.yaml
  name: "0"
  name: all
$ podman run --rm --device nvidia.com/gpu=all ubuntu nvidia-smi -L
Error: stat nvidia.com/gpu=all: no such file or directory
$ podman run --rm --device nvidia.com/gpu=gpu0 --device nvidia.com/gpu=mig1:0 ubuntu nvidia-smi -L
Error: stat nvidia.com/gpu=gpu0: no such file or directory

Can you elaborate more about how did you install nvidia tao platform.

More, for TAO toolkit, please refer to user guide TAO Toolkit - NVIDIA Docs

  1. First install linux-headers.
  2. Download the latest nvidia drivers from Official Drivers | NVIDIA.
  3. Follow the instructions at Install Docker Engine to install docker-ce
  4. Install the NVIDIA Container Toolkit CLI
distribution=$(. /etc/os-release;echo $ID$VERSION_ID) 
curl -s -L https://nvidia.github.io/nvidia-docker/$distribution/nvidia-docker.list | tee /etc/apt/sources.list.d/nvidia-docker.list
curl -s -L https://nvidia.github.io/nvidia-docker/$distribution/nvidia-docker.list | \ sudo tee /etc/apt/sources.list.d/nvidia-docker.list
sudo apt update && sudo apt install -y nvidia-container-toolkit-base
nvidia-ctk --version

Then the error above appeared

Hardware environment:
CPU: AMD R9 3900X
Memory: 64G DDR4
Graphics card: RTX 3070
Hard disk: 10T SSD

There is no update from you for a period, assuming this is not an issue anymore. Hence we are closing this topic. If need further support, please open a new one. Thanks

You can ignore the CDI and follow Installation Guide — NVIDIA Cloud Native Technologies documentation to go ahead.

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.