I setup a Azure VM using a Standard NC40ads H100 v5 with the following image:
NVIDIA GPU-Optimized VMI - v24.05.1
Source image offer: ngc_azure_17_11
Source image plan: base-version-24_05_1-gen2
And it gives the following error:
Installing drivers ...
modprobe: FATAL: Module nvidia not found in directory /lib/modules/6.5.0-1018-azure
Install complete
Installing drivers ...
modprobe: FATAL: Module nvidia not found in directory /lib/modules/6.5.0-1018-azure
Install complete
I have tried logging in multiple times, as some people have claimed that fixed it for them. I also tried running this image with an A100 instance.