Could not select device driver "" with capabilities [[gpu]]

I am running rootless docker with

  • Ubuntu 20.04
  • cuda 10.1.243
  • Docker 20.10.14
  • nvidia-docker2

I run the follwing with the error…

docker run --entrypoint /bin/bash -it --gpus all --rm nvcr.io/ea-reopt-member-zone/ea-cuopt

docker: Error response from daemon: could not select device driver "" with capabilities: [[gpu]].

I have the NVIDIA-toolkit installed (GitHub - NVIDIA/nvidia-docker: Build and run Docker containers leveraging NVIDIA GPUs) following another post on this issue could not select device driver "" with capabilities: [[gpu]]. - #4 by bkakilli

@ryanmelnick

How did you install docker?

I have had good results with the Docker CE version and nvidia-container-toolkit, although admittedly the install steps for Docker CE from NVIDIA are much longer.

docker was installed using apt package manager on my machine (GCP). But its rootless docker if that means anything.