CUDA Not Available on Jetson Orin Nano Despite Installation

spacelabs.eon · October 8, 2024, 8:39am

Hi everyone,

I’ve recently purchased an NVIDIA Jetson Orin Nano Developer Kit and flashed it with an SD card image (JetPack 6.0). I’ve also added an SSD for extra storage, and everything seemed to go smoothly. However, I encountered an issue when trying to use the GPU for my YOLO project to achieve real-time, high FPS object detection.

Here’s the problem:

CUDA Version: According to nvcc --version, I have CUDA 12.2.140 installed (see attached image).

Jtop Output: When I run jtop, it shows that CUDA 12.2.140 and other libraries like cuDNN and TensorRT are installed, but OpenCV is showing “with CUDA: NO”.

PyTorch: When I try to use CUDA through PyTorch, torch.cuda.is_available() returns False. I also get an error message: “Torch not compiled with CUDA enabled” (see attached images).

TorchVision: The version of TorchVision installed is 0.19.1 (see attached screenshot).

I’ve verified that JetPack 6.0 is installed, and the CUDA toolkit is recognized, but I can’t seem to get CUDA to work with PyTorch. The GPU functionality is crucial for running YOLO with acceptable performance, and without CUDA, I’m unable to use the GPU.

Steps I’ve Taken:

Installed JetPack 6.0 via SD card flash.
Verified CUDA with nvcc --version.
Tried using PyTorch, but it says CUDA is not available.
System Info:

Jetson Orin Nano Developer Kit
JetPack Version: 6.0
CUDA: 12.2.140
Python Version: 3.10.12
PyTorch Version: 2.4.1
TorchVision Version: 0.19.1
Attached are the screenshots from jtop, the PyTorch output, TorchVision version, and CUDA verification (nvcc output).

Any help or guidance to get CUDA running properly on this setup would be greatly appreciated. I need the GPU for high FPS on my YOLO project.

Thanks in advance!

AastaLLL · October 9, 2024, 5:15am

Hi,

The default OpenCV within JetPack doesn’t build with CUDA support.
Please install it from the source with the script below instead.

github.com

AastaNV/JEP/blob/master/script/install_opencv4.9.0_Jetpack6.sh

#!/bin/bash
#

version="4.9.0"
folder="workspace"

set -e

for (( ; ; ))
do
    echo "Do you want to remove the default OpenCV (yes/no)?"
    read rm_old

    if [ "$rm_old" = "yes" ]; then
        echo "** Remove other OpenCV first"
        sudo apt -y purge *libopencv*
	break
    elif [ "$rm_old" = "no" ]; then
	break
    fi

This file has been truncated. show original

You can also find PyTorch and TorchVision with CUDA support in the below link:

Thanks.

system · November 6, 2024, 5:36am

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
CUDA Not Detected in PyTorch - Unable to Use GPU for YOLO Training Jetson Orin NX cuda , pytorch	8	211	December 13, 2024
No NVIDIA GPU available or detected on Nvidia Jetson Orin Nano Jetson Orin Nano cuda , gpu	3	180	July 4, 2024
How to use Cuda with torch in jetson orin nano with jetpack 5.1.2 Jetson Orin Nano cuda	2	456	December 26, 2023
No CUDA device available Jetson Nano cuda	2	377	January 15, 2024
Pytorch with CUDA support Jetson Orin Nano Jetson Orin Nano cuda , pytorch , python , cudnn	4	799	May 14, 2024
Unable to Connect CUDA with YOLOv8 on Jetson Xavier AGX Jetson AGX Xavier cuda , yolo	6	63	November 18, 2024
AssertionError: CUDA unavailable, invalid device 0 requested on jetson Nano Jetson Nano cuda , yolo	8	9557	September 5, 2021
Jetson orin nano Cuda Cudnn torch torchauido torchvision Jetson Orin Nano cuda	11	736	May 27, 2024
Regarding the issue of CUDA and Pytorch Jetson Nano cuda , pytorch	4	142	November 21, 2024
Upgrading CUDA 11.4 to CUDA 11.8 Jetson Orin NX cuda	3	600	September 9, 2024

CUDA Not Available on Jetson Orin Nano Despite Installation

Related topics