Couldn’t find any working combination for JetPack 6.2. My CUDA version is 12.6, Please help me. Thanks

Hi, You should be able to find our prebuilt for JetPack 6 with the link shared above. Did you meet any issues when installing it? Thanks.

Could I use the command to install on sm_87 AGX Orin? pip install torch==2.5.1 torchvision==0.20.1 torchaudio==2.5.1 --index-url https://download.pytorch.org/whl/cu124

bumping this post for move visability I also can’t find a working version of any of these packages for the agx orin with jetpack 6.2 pytorch, torch vision, tensorrt-llm, tensorrt-llm edge. All fail to build on this device

These don’t work? https://pypi.jetson-ai-lab.io/jp6/cu126

Hi, Please find the packages for JetPack 6.2 in the link below: jp6/cu126 index Thanks.

I can confirm both the 3.14 wheel and 3.16 wheel for the python llamapythoncpp have the same corruption error as the official llamapythoncpp library. So looking over this, at least with my agx there is no currently supported version that has the correct fix. If the KV cache fills to quickly, then it…

Is this how you installed the package? If not try it. CMAKE_ARGS="-DGGML_CUDA=on" pip install llama-cpp-python

I uninstalled everything and freshly reset all of my libraries. I upgraded to 12.9 cuda, i ran the proper wheel install for that version, and i tried the method you just gave again. Still same problem. [Screenshot from 2026-01-22 00-04-16]

Hi, Sorry for the late update. Could you test if PyTorch can work correctly? If yes, this might be an issue from llamacpp. Thanks.

I can confirm, llamacpp has an issue, but also pytorch is a nightmare to install. I will return to the other llm focused post that covers this in more [image] LLM library recomendations for maximum token speeds Jetson AGX Orin Hi, Please find below how to set…

PyTorch and TorchVision for Jetpack 6.2

Robotics & Edge Computing Jetson Systems Jetson AGX Orin

seanmurp19 February 16, 2026, 8:57pm 16

I can confirm, llamacpp has an issue, but also pytorch is a nightmare to install. I will return to the other llm focused post that covers this in more

Topic		Replies	Views
CUDA Enabled PyTorch for JetPack6.2.1 Jetson AGX Orin pytorch	4	242	November 5, 2025
Install torch on latest Jetpack 6.2 Jetson AGX Orin pytorch	3	310	April 25, 2025
Install a CUDA compiled version of Torch in Jetson Orin AGX with jetpack 6.2 Jetson AGX Orin cuda	2	232	July 24, 2025
Unable to install pytorch and torchvision on jetson orin Jetson AGX Orin pytorch	14	1298	March 19, 2025
Pytorch(Cuda is False) is for Jetpack 6.1 on Jetson Orin Agx Jetson AGX Orin pytorch	3	288	December 9, 2024
Incompatible torch2.2+Cuda12.2 wheel with other python libraries for AGX Orin Jetpack6.0 Jetson AGX Orin cuda , pytorch	8	2749	May 17, 2024
[Orin AGX] pytorch install problem Jetson AGX Orin cuda , pytorch	4	277	September 18, 2025
Unable to install Torch on jetson agx orin (Im going insane) Jetson AGX Orin cuda , yolo , pytorch , cudnn	2	261	August 22, 2025
Which Cuda and pytroch with Jetpack 6 on Jetson agx orin dev kit Jetson AGX Orin cuda , pytorch	1	237	November 14, 2024
Add PyTorch 2.8.0 to JP6 cu128 index & jtop JetPack version missing on Orin AGX with JetPack 6.2.1 Jetson AGX Orin pytorch , cudnn	5	388	September 25, 2025

PyTorch and TorchVision for Jetpack 6.2

Related topics