as described here: https://developer.nvidia.com/nvidia-development-tools-solutions-err_nvgpuctrperm-permission-issue-performance-counters. I tried
modprobe -r nvidia_uvm nvidia_drm nvidia_modeset nvidia-vgpu-vfio nvidia, it comes out bash: modprobe: command not found,
sudo also does not work.
cuda: 11.3
driver: 510.54