Cannot start driver after driver installation

I’m using GCP VM with A100 GPU. I followed NVIDIA CUDA Installation Guide for Linux to install the driver. However, seems the device cannot be found. Specifically,
“sudo systemctl enable nvidia-persistenced && systemctl status nvidia-persistenced” returns following error
" nvidia-persistenced.service - NVIDIA Persistence Daemon
Loaded: loaded (/lib/systemd/system/nvidia-persistenced.service; enabled; vendor preset: enabled)
Active: failed (Result: exit-code) since Sun 2023-07-23 06:52:20 UTC; 21min ago
CPU: 13ms
Jul 23 06:52:20 wuxiao-colab-vm systemd[1]: Starting NVIDIA Persistence Daemon…
Jul 23 06:52:20 wuxiao-colab-vm nvidia-persistenced[554]: Started (554)
Jul 23 06:52:20 wuxiao-colab-vm nvidia-persistenced[554]: Failed to query NVIDIA devices. Please ensure that the NVIDIA device files (/dev/nvidia) exist, and that user 109 has read and write permissions for tho*>
Jul 23 06:52:20 wuxiao-colab-vm nvidia-persistenced[552]: nvidia-persistenced failed to initialize. Check syslog for more details.
Jul 23 06:52:20 wuxiao-colab-vm nvidia-persistenced[554]: Shutdown (554)
Jul 23 06:52:20 wuxiao-colab-vm systemd[1]: nvidia-persistenced.service: Control process exited, code=exited, status=1/FAILURE
Jul 23 06:52:20 wuxiao-colab-vm systemd[1]: nvidia-persistenced.service: Failed with result ‘exit-code’.
Jul 23 06:52:20 wuxiao-colab-vm systemd[1]: Failed to start NVIDIA Persistence Daemon."

The user 109 is “nvpd” BTW.

There’s no /dev/nvidia* in my system. However, “lspci | grep -i nvidia” returns
00:05.0 3D controller: NVIDIA Corporation GA100 [A100 SXM4 80GB] (rev a1)