# Using Pytorch on GPU after upgrading cuda to 11.8 on Jetpack5 **URL:** \ **Category:** Jetson AGX Xavier\ **Tags:** pytorch, cuda\ **Created:** [July 31, 2023, 8:46am UTC](https://forums.developer.nvidia.com/t/using-pytorch-on-gpu-after-upgrading-cuda-to-11-8-on-jetpack5/261554 "2023-07-31T08:46:51Z")\ **Posts on this page:** 9\ **Page:** 1
**Author:** ![YoushaaMurhij](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/youshaamurhij/32/29681_2.png) [@YoushaaMurhij](https://forums.developer.nvidia.com/u/YoushaaMurhij)\ **Post date:** [July 31, 2023, 8:46am UTC](https://forums.developer.nvidia.com/t/using-pytorch-on-gpu-after-upgrading-cuda-to-11-8-on-jetpack5/261554/1 "2023-07-31T08:46:51Z")
I managed to upgrade CUDA to 11.8 on AGX Xavier with JetPack 5.1 inside a container `nvcr.io/nvidia/l4t-pytorch:r35.2.1-pth2.0-py3` . but after that, I could not use Pytorch on GPU as torch.cuda.is\_available() returns False. Any suggestions? ---
**Author:** ![dusty\_nv](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/dusty_nv/32/14043_2.png) [@dusty\_nv](https://forums.developer.nvidia.com/u/dusty_nv)\ **Post date:** [July 31, 2023, 2:58pm UTC](https://forums.developer.nvidia.com/t/using-pytorch-on-gpu-after-upgrading-cuda-to-11-8-on-jetpack5/261554/2 "2023-07-31T14:58:04Z")
@YoushaaMurhij you might want to try re-installing the PyTorch 2.0 wheel that has CUDA support from here: > [@PyTorch for Jetson](https://forums.developer.nvidia.com/t/pytorch-for-jetson/72048): > > Below are pre-built PyTorch pip wheel installers for Jetson Nano, TX1/TX2, Xavier, and Orin with JetPack 4.2 and newer. Download one of the PyTorch binaries from below for your version of JetPack, and see the installation instructions to run on your Jetson. These pip wheels are built for ARM aarch64 architecture, so run these commands on your Jetson (not on a host PC). You can also use the pre-built [l4t-pytorch](https://ngc.nvidia.com/catalog/containers/nvidia:l4t-pytorch) and [l4t-ml](https://ngc.nvidia.com/catalog/containers/nvidia:l4t-ml) container images and [Dockerfiles](https://github.com/dusty-nv/jetson-containers). PyTorch pip wheels JetPack 5 > > > **PyTo…** > > Or baring that, rebuild PyTorch from source for CUDA 11.8 following the `Build from Source` instructions from that thread. I haven’t tried upgrading CUDA with PyTorch before, so YMMV. Also if/when you go to build torchvision, the CUDA versions will need to match otherwise PyTorch will throw an error about it. ---
**Author:** ![YoushaaMurhij](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/youshaamurhij/32/29681_2.png) [@YoushaaMurhij](https://forums.developer.nvidia.com/u/YoushaaMurhij)\ **Post date:** [July 31, 2023, 3:03pm UTC](https://forums.developer.nvidia.com/t/using-pytorch-on-gpu-after-upgrading-cuda-to-11-8-on-jetpack5/261554/4 "2023-07-31T15:03:38Z")
@dusty_nv, Thanks for you response. I have already tried to install PyTorch from this whl: - [`torch-2.0.0+nv23.05-cp38-cp38-linux_aarch64.whl`](https://nvidia.box.com/shared/static/i8pukc49h3lhak4kkn67tg9j4goqm0m7.whl). But the same problem is still there. I will try to install PyTorch from source. ---
**Author:** ![YoushaaMurhij](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/youshaamurhij/32/29681_2.png) [@YoushaaMurhij](https://forums.developer.nvidia.com/u/YoushaaMurhij)\ **Post date:** [August 7, 2023, 1:50pm UTC](https://forums.developer.nvidia.com/t/using-pytorch-on-gpu-after-upgrading-cuda-to-11-8-on-jetpack5/261554/5 "2023-08-07T13:50:00Z")
Installing PyTorch from source does not solve the problem. i wonder if I need to upgrade Cuda version on the host (Jetson Xavier with Jetpack 5) before trying to upgrade it inside a container! or does the l4t container just have a direct access to the cuda which is installed on the host? ---
**Author:** ![dusty\_nv](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/dusty_nv/32/14043_2.png) [@dusty\_nv](https://forums.developer.nvidia.com/u/dusty_nv)\ **Post date:** [August 7, 2023, 6:24pm UTC](https://forums.developer.nvidia.com/t/using-pytorch-on-gpu-after-upgrading-cuda-to-11-8-on-jetpack5/261554/6 "2023-08-07T18:24:40Z")
@YoushaaMurhij on JetPack 5, CUDA/cuDNN/TensorRT/ect are installed inside the container (as opposed to being mounted from your device, like they were on JetPack 4). I haven’t attempted to upgrade CUDA and try it with PyTorch, so I’m not sure what the proper sequence is to try. ---
**Author:** ![herr\_dieter\_graef](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@herr\_dieter\_graef](https://forums.developer.nvidia.com/u/herr_dieter_graef)\ **Post date:** [August 7, 2023, 7:08pm UTC](https://forums.developer.nvidia.com/t/using-pytorch-on-gpu-after-upgrading-cuda-to-11-8-on-jetpack5/261554/7 "2023-08-07T19:08:07Z")
There is a working Cuda 12 for Jetson available from here : [CUDA Toolkit 12.0 Downloads | NVIDIA Developer](https://developer.nvidia.com/cuda-12-0-0-download-archive?target_os=Linux&target_arch=aarch64-jetson) I had to use at least the assembler nvptxas from there to get OpenAI’s Triton language vers. 2 working on Jetson Orin NX. ---
**Author:** ![YoushaaMurhij](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/youshaamurhij/32/29681_2.png) [@YoushaaMurhij](https://forums.developer.nvidia.com/u/YoushaaMurhij)\ **Post date:** [August 7, 2023, 7:31pm UTC](https://forums.developer.nvidia.com/t/using-pytorch-on-gpu-after-upgrading-cuda-to-11-8-on-jetpack5/261554/8 "2023-08-07T19:31:15Z")
I have tried CUDA 11.8 but could not manage to use Pytorch on GPU. Have you @herr_dieter_graef succeed with upgrading to CUDA 12.0? ---
**Author:** ![herr\_dieter\_graef](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@herr\_dieter\_graef](https://forums.developer.nvidia.com/u/herr_dieter_graef)\ **Post date:** [August 7, 2023, 8:06pm UTC](https://forums.developer.nvidia.com/t/using-pytorch-on-gpu-after-upgrading-cuda-to-11-8-on-jetpack5/261554/9 "2023-08-07T20:06:08Z")
No i did not since i feared problems with all the other stuff i build from sources. I only used the assembler from Cuda 12. But since it is a release for Jetson it should work. ---
**Author:** ![system](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/system/32/68080_2.png) [@system](https://forums.developer.nvidia.com/u/system)\ **Post date:** [August 30, 2023, 5:00am UTC](https://forums.developer.nvidia.com/t/using-pytorch-on-gpu-after-upgrading-cuda-to-11-8-on-jetpack5/261554/11 "2023-08-30T05:00:07Z")
This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.