Nvidia-container-toolkit erroring out when running as non-root

I am running Fedora Silverblue 34 on a Thinkpad T460p with a GeForce 940MX.
Here is the output of uname --all:

Linux fedora 5.14.13-200.fc34.x86_64 #1 SMP Mon Oct 18 12:39:31 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

and here is the output of running nvidia-smi on the host:

Mon Oct 25 17:53:48 2021       
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 470.74       Driver Version: 470.74       CUDA Version: 11.4     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  NVIDIA GeForce ...  On   | 00000000:02:00.0 Off |                  N/A |
| N/A   27C    P8    N/A /  N/A |      0MiB /  2004MiB |      0%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+
                                                                               
+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
|  No running processes found                                                 |
+-----------------------------------------------------------------------------+

Now here’s the problem: when I run the following command as non-root user:

podman run --rm --security-opt=label=disable \
     --hooks-dir=/usr/share/containers/oci/hooks.d/ \
     nvidia/cuda:11.0-base nvidia-smi

it errors out with the following error message in the nvidia-container-toolkit debug log file:

E1025 01:42:52.128764 37775 nvc_mount.c:788] error mounting directory /usr/lib/firmware/nvidia/470.74

That same podman command works fine when it’s run as root.

Here is the entire debug log file (with the actual username replaced with ${USER}):

nvidia-container-toolkit-rootless.log (13.5 KB)