There is no mismatch between CUDA version then why Is CUDA available: False?

Collecting environment information...
/home/user/anaconda3/envs/tf-gpu/lib/python3.6/site-packages/torch/cuda/__init__.py:52: UserWarning: CUDA initialization: CUDA unknown error - this may be due to an incorrectly set up environment, e.g. changing env variable CUDA_VISIBLE_DEVICES after program start. Setting the available devices to be zero. (Triggered internally at  /opt/conda/conda-bld/pytorch_1607370116979/work/c10/cuda/CUDAFunctions.cpp:100.)
  return torch._C._cuda_getDeviceCount() > 0
PyTorch version: 1.7.1
Is debug build: False
CUDA used to build PyTorch: 10.1
ROCM used to build PyTorch: N/A

OS: Ubuntu 20.04.1 LTS (x86_64)
GCC version: (Ubuntu 9.4.0-1ubuntu1~20.04.2) 9.4.0
Clang version: Could not collect
CMake version: version 3.16.3

Python version: 3.6 (64-bit runtime)
Is CUDA available: False
CUDA runtime version: 10.1.243
GPU models and configuration: GPU 0: GeForce RTX 2070 SUPER
Nvidia driver version: 450.119.03
cuDNN version: Could not collect
HIP runtime version: N/A
MIOpen runtime version: N/A

Versions of relevant libraries:
[pip3] numpy==1.19.2
[pip3] torch==1.7.1
[pip3] torchaudio==0.7.0a0+a853dff
[pip3] torchvision==0.8.2
[conda] blas                      1.0                         mkl  
[conda] cudatoolkit               10.1.243             h6bb024c_0  
[conda] mkl                       2020.2                      256  
[conda] mkl-service               2.3.0            py36he8ac12f_0  
[conda] mkl_fft                   1.3.0            py36h54f3939_0  
[conda] mkl_random                1.1.1            py36h0573a6f_0  
[conda] numpy                     1.19.2           py36h54aff64_0  
[conda] numpy-base                1.19.2           py36hfa32c7d_0  
[conda] pytorch                   1.7.1           py3.6_cuda10.1.243_cudnn7.6.3_0    pytorch
[conda] torchaudio                0.7.2                      py36    pytorch
[conda] torchvision               0.8.2                py36_cu101    pytorch
CUDA used to build PyTorch: 10.1
CUDA runtime version: 10.1.243

There is no mismatch between CUDA version then why Is CUDA available: False?

Did you follow up on this hint given by pyTorch?

1 Like

Yes I saw the post. I believe my issue is not the same with them.

I found a question on Stackoverflow(CUDA initialization: CUDA unknown error - this may be due to an incorrectly set up environment) which had same problem like me. As a solution they suggested to use

sudo rmmod nvidia_uvm
sudo modprobe nvidia_uvm

I tried the 1st command on terminal sudo rmmod nvidia_uvm. It returned rmmod: ERROR: Module nvidia_uvm is not currently loaded, What is the meaning of the error and how could I solve it?

You seem to be on Ubuntu?

Sorry, can’t help you since outside my area of expertise. nvidia_uvm is presumably the part of the driver stack that provides unified virtual memory, something that CUDA needs.