Ive found the issue,
I did use Sudo, however I was missing some install packages. Ive copied the install list from this repo GitHub - atinfinity/sdk_manager_docker: Dockerfile to use NVIDIA SDK Manager on Docker container into my own Docker image and it works fine now.