Thanks. I think you suggesting I build the kernel driver from GitHub GitHub - NVIDIA/gds-nvidia-fs: NVIDIA GPUDirect Storage Driver ? But I couldn’t find version 2.17.3 in any of the GitHub branches or releases, so I didn’t proceed with the build—mainly because I’m unsure which version is correct.
Given our setup—DGX-A100 running OS 6 with the optimized NVIDIA kernel 5.15.0-1091-nvidia and the proprietary GPU driver 580.65.06—I’m wondering which branch of nvidia-fs I should actually build. (I’m fine with building from a different branch. But for new release of GDS the driver need to be switched to open source one)
—
The header is in, but in another folder:
$ ls /usr/src/nvidia-srv-580.95.05/nvidia/nv-p2p.h
/usr/src/nvidia-srv-580.95.05/nvidia/nv-p2p.h
And we have the `nvidia-kernel-source-580-server` instead of the one you listed. And we have the proprietary GPU driver on DGX OS 6, not sure the open one fits here:
$ apt list | grep nvidia-kernel-source-580
nvidia-kernel-source-580-open/unknown 580.95.05-0ubuntu1 amd64
nvidia-kernel-source-580-server-open/jammy-updates,jammy-security 580.95.05-0ubuntu0.22.04.2 amd64
nvidia-kernel-source-580-server/jammy-updates,jammy-security,now 580.95.05-0ubuntu0.22.04.2 amd64 [installed,automatic]
nvidia-kernel-source-580/unknown 580.95.05-0ubuntu1 amd64$ sudo apt install nvidia-dkms-${NVIDIA_DRV_VERSION}-server --dry-run
Reading package lists… Done
Building dependency tree… Done
Reading state information… Done
The following NEW packages will be installed:
nvidia-dkms-580-server
0 upgraded, 1 newly installed, 0 to remove and 39 not upgraded.
Inst nvidia-dkms-580-server (580.95.05-0ubuntu0.22.04.2 Ubuntu:22.04/jammy-updates, Ubuntu:22.04/jammy-security [amd64])
Conf nvidia-dkms-580-server (580.95.05-0ubuntu0.22.04.2 Ubuntu:22.04/jammy-updates, Ubuntu:22.04/jammy-security [amd64])