We are working with Jetson AGX orin 64GB. After installing jetpack and all the necessary libraries, torch is not been able to detect the GPU and fall backs on CPU. Can someone help us with this.
Also, we are been able to run inference on GPU using .trtexec CLI tool. We are facing issue in running inference on GPU using script.
Hi @callbhargavp, did you install one of the CUDA-enabled PyTorch wheels for JetPack 5.x from this thread: https://forums.developer.nvidia.com/t/pytorch-for-jetson-version-1-11-now-available/72048
You could also use the pre-built l4t-pytorch containers from NGC: https://catalog.ngc.nvidia.com/orgs/nvidia/containers/l4t-pytorch
This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.