In PyTorch 6.1, the GPU is not working

Robotics & Edge Computing Jetson & Embedded Systems Jetson AGX Orin
1

The basic configuration of the device is: Jetson AGX Orin 64G, JetPack 6.1, CUDA 12.6.
I downloaded “torch-2.5.0-cp310-cp310-linux_aarch64.whl” from jp6/cu126 index.
After installation, the GPU is not working. What could be the reason?

import torch
print(torch.cuda.is_available())
False

3

Hi,
Here are some suggestions for the common issues:

1. Performance

Please run the below command before benchmarking deep learning use case:

$ sudo nvpmodel -m 0
$ sudo jetson_clocks

2. Installation

Installation guide of deep learning frameworks on Jetson:

3. Tutorial

Startup deep learning tutorial:

4. Report issue

If these suggestions don’t help and you want to report an issue to us, please attach the model, command/step, and the customized app (if any) with us to reproduce locally.

Thanks!

5

Hi,

Could you share the below info with us?

import torch
torch.__version__

Thanks.

10

I found the cause of the problem, but I don’t know how to solve it. I
have installed PyTorch, and installing only PyTorch does support CUDA.
However, after I installed torchvision, it automatically reinstalled a different version of PyTorch, causing CUDA to stop working.
“torchvision 0.20.0 requires torch==2.5.0, but you have torch 2.5.0a0+872d972e41.nv24.8 which is incompatible.”

The current issue is how to install PyTorch and torchvision in a compatible manner.

11

There is no update from you for a period, assuming this is not an issue anymore.
Hence, we are closing this topic. If need further support, please open a new one.
Thanks

Hi,

Do you mean when you print out the torch.cuda.is_available() and it returns False?
Thanks.