After installing the nvidia drivers using:
sudo ubuntu-drivers install --gpgpu
and also setting manually the version (tried multiple versions, like 570, 560, 535 after purge nvidia and reboot machine each time) with the command:
sudo ubuntu-drivers install --gpgpu nvidia:570-server
sudo lspci -k -d 10de:*
82:00.0 3D controller: NVIDIA Corporation GH100 [H100L 94GB] (rev a1)
Subsystem: NVIDIA Corporation GH100 [H100L 94GB]
Kernel modules: nvidiafb, nouveau