Cannot get Torch met CUDA to work on Jetson Orin

[dusty_nv]

@laurent049pc

I read many topics on this but none is working. It is quite wierd that it should take so much time to setup an cuda environment for nvidia jetson.

@laurent049pc the SD card image already comes with the GPU drivers, CUDA Toolkit, ect pre-installed on it. The Jetson’s integrated GPU drivers are different than the discrete GPU drivers in the ubuntu apt repo. Since you installed those, I would just re-flash your SD card and start fresh to alleviate any conflicts from them in the future.

@laurent049pc

I have tried many things (spent hours) to go through the support but i cannot get it to to work. Issue with compilation, various version etc… Is there any proper documentation from the standard SD image to make Torch using CUDA?

Install one of the pre-built PyTorch wheels that have CUDA support for your version of JetPack from this thread:

PyTorch for Jetson

Below are pre-built PyTorch pip wheel installers for Jetson Nano, TX1/TX2, Xavier, and Orin with JetPack 4.2 and newer. Download one of the PyTorch binaries from below for your version of JetPack, and see the installation instructions to run on your Jetson. These pip wheels are built for ARM aarch64 architecture, so run these commands on your Jetson (not on a host PC). You can also use the containers from jetson-containers. PyTorch pip wheels JetPack 6 ▶ PyTorch v2.3.0 ▶ PyTorch v2.2.0 ▶ PyT…

Or you can also use l4t-pytorch container which comes with PyTorch, torchvision, and torchaudio pre-installed in them.