# CUDA driver issues DGX-1 ??

**URL:** <https://forums.developer.nvidia.com/t/cuda-driver-issues-dgx-1/67387>\
**Category:** Container: CUDA\
**Created:** [November 14, 2018, 2:05pm UTC](https://forums.developer.nvidia.com/t/cuda-driver-issues-dgx-1/67387 "2018-11-14T14:05:01Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![anthony.morse](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@anthony.morse](https://forums.developer.nvidia.com/u/anthony.morse)\
**Post date:** [November 14, 2018, 2:05pm UTC](https://forums.developer.nvidia.com/t/cuda-driver-issues-dgx-1/67387/1 "2018-11-14T14:05:01Z")

</div>

Hi, I’m new to using NGC so please forgive me if I’ve missed something obvious…

I’ve pulled CUDA using: sudo docker pull [nvcr.io/nvidia/cuda:latest](http://nvcr.io/nvidia/cuda:latest)  
I then run it with: sudo nvidia-docker run -i -t f072016d63a4  
or with sudo docker run -i -t f072016d63a4

and it all seems fine, nvcc -V returns…  
nvcc: NVIDIA (R) Cuda compiler driver  
Copyright (c) 2005-2018 NVIDIA Corporation  
Built on Sat\_Aug\_25\_21:08:01\_CDT\_2018  
Cuda compilation tools, release 10.0, V10.0.130

However when I try to run any CUDA code (code that works fine elsewhere) it either simply doesn’t run the CUDA parts, or returns this error…  
ERROR: Kernel SOM\_OnDevice Failed!: CUDA driver version is insufficient for CUDA runtime version

I could update the driver, but given that this is a container/image I shouldn’t have this problem right???

Also is there any way to install an editor (nano would do) just once so that its there each time I fire up the container rather than having to reinstall it each time.

---

<div class="post-metadata">

**Author:** ![Cliff\_Woolley](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/cliff_woolley/32/14043_2.png) [@Cliff\_Woolley](https://forums.developer.nvidia.com/u/Cliff_Woolley)\
**Post date:** [November 14, 2018, 5:04pm UTC](https://forums.developer.nvidia.com/t/cuda-driver-issues-dgx-1/67387/2 "2018-11-14T17:04:08Z")

</div>

Our NVIDIA GPU Cloud DL Frameworks images versioned 18.09 and later are built on CUDA 10, but they also include the (new) compatibility layer that allow them to work on R384 drivers that previously shipped on DGX-1 and DGX-Station. You don’t have to wait for a new DGX OS to use them.

But here the specific question is about `nvcr.io/nvidia/cuda:latest`, which is a CUDA 10 image without the compatibility layer. You can either install cuda-compat-10-0 into that image (but beware the image will then not work with other R410 drivers, _only_ with the compatibility case – a circumstance we went to some lengths to work around for you in the DL Frameworks images) or you can upgrade your driver or you can use a nvidia/cuda image based on CUDA 9 instead of `:latest`.

---

<div class="post-metadata">

**Author:** ![anthony.morse](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@anthony.morse](https://forums.developer.nvidia.com/u/anthony.morse)\
**Post date:** [November 15, 2018, 9:59am UTC](https://forums.developer.nvidia.com/t/cuda-driver-issues-dgx-1/67387/3 "2018-11-15T09:59:56Z")

</div>

I’m still stuck with this. I’ve tried pulling and running CUDA 9-devel and I have exactly the same issue there. I’ve updated the system to the latest base and still no GPU’s detected… what have I missed?

---

<div class="post-metadata">

**Author:** ![laris.qiao](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@laris.qiao](https://forums.developer.nvidia.com/u/laris.qiao)\
**Post date:** [December 11, 2018, 7:34am UTC](https://forums.developer.nvidia.com/t/cuda-driver-issues-dgx-1/67387/4 "2018-12-11T07:34:04Z")

</div>

Hi Anthony,

You can send detail to [enterprisesupport@nvidia.com](mailto:enterprisesupport@nvidia.com) go get NVIDIA Enterprise Support if your DGX-1 have valid service entitlement.

---

<div class="post-metadata">

**Author:** ![bilal.siddiqui](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@bilal.siddiqui](https://forums.developer.nvidia.com/u/bilal.siddiqui)\
**Post date:** [May 18, 2019, 4:31am UTC](https://forums.developer.nvidia.com/t/cuda-driver-issues-dgx-1/67387/5 "2019-05-18T04:31:43Z")

</div>

I need to use CUDA 10.0.  
I understand that the 384.145 driver can work with the aforementioned version. However, there seems to be a lack of resources on documenting how a user can add the new toolkit. I installed [b][https://developer.nvidia.com/cuda-10.0-download-archive[/b]](https://developer.nvidia.com/cuda-10.0-download-archive%5B/b%5D) but when using a framework (darknet) I am greeted with CUDA Error: CUDA driver version is insufficient for CUDA runtime version.

btw:

\> nvcc --version  
nvcc: NVIDIA (R) Cuda compiler driver  
Copyright (c) 2005-2018 NVIDIA Corporation  
Built on Sat\_Aug\_25\_21:08:01\_CDT\_2018  
Cuda compilation tools, release 10.0, V10.0.130

---

<div class="post-metadata">

**Author:** ![TomNVIDIA](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/tomnvidia/32/14181_2.png) [@TomNVIDIA](https://forums.developer.nvidia.com/u/TomNVIDIA)\
**Post date:** [October 12, 2021, 4:28pm UTC](https://forums.developer.nvidia.com/t/cuda-driver-issues-dgx-1/67387/6 "2021-10-12T16:28:53Z")

</div>


