Unable to install Torch on jetson agx orin (Im going insane)

Hello lovely people, I have tried so many different solutions but I cannot seem to get this to work and I am at my wits end!

How do I install the correct PyTorch and Cuda version ect for the Jetson Agx Orin, it was all working with Yolo and everything then smth messed up and along the way everything has unraveled.

Jtop info:
Platform: aarch64
System: Linux
Dis: Ubuntu 22
Release: 5.15.148 Tegra
Python: 3.10.12

Libraries:
CUDA: 12.6.68
cuDNN: 9.3.0.75
TensorRT: 10.3.0.30
vpi: 3.2.4
Vulkan: 1.3.204
OpenCV: 4.10.0 with CUDA: YES
**** This was “CUDA: NO” at the beginning of this mess, so at least thats fixed
L4T: 36.4.4
Jetpack: 6.2.1

I’ve tried (and failed):

and other ‘solutions’ ect - please someone help this poor soul.

Latest error:
w_bn = torch.diag(bn.weight.div(torch.sqrt(bn.eps + bn.running_var)))

RuntimeError: CUDA error: no kernel image is available for execution on the device
CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect.
For debugging consider passing CUDA_LAUNCH_BLOCKING=1
Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

Did you install this?

export TORCH_INSTALL=https://developer.download.nvidia.cn/compute/redist/jp/v61/pytorch/torch-2.5.0a0+872d972e41.nv24.08.17622132-cp310-cp310-linux_aarch64.whl
python3 -m pip install --no-cache $TORCH_INSTALL

Hi,

Please refer to the download center

And install prebuilt torch wheel.

Thanks

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.