I have set up the docker containers successfully(Install Docker Desktop on Ubuntu | Docker Documentation). When I tried to create a container accessing all_gpu(command: ./docker/launch.sh --tag tensorrt-ubuntu18.04-cuda11.4 --gpus all) it shows the NVIDIA driver accessing GPUs issue.
I have not faced any issues in docker and tensorRT setup.
When I installed the NVIDIA drivers needed as a pre-requisite to install the Cuda toolkit, it got successfully installed but when I tried to reboot the Laptop for changes it didn’t boot.
Kindly suggest me the solution to resolve the issues related to NVIDIA drivers to access GPUs.
And kindly let me know the difference between both docker and NGC docker for running any deep learning model? Will NGC docker doesn’t need NVIDIA drivers for accessing the GPUs?
I will try to follow the link shared by you and try to run the NGC docker for model inference.
NGC containers are GPU-optimized containers such that running on Nvidia GPU with Nvidia container should have best possible performance. NGC containers as well need drivers.
This issue looks like more related to setup related issue. We are moving this post to a relevant forum to get better help.