# How to Install Torch\_TensorRT for Jetson AGX ORIN **URL:** \ **Category:** Jetson AGX Orin\ **Tags:** tensorrt\ **Created:** [June 4, 2025, 6:08am UTC](https://forums.developer.nvidia.com/t/how-to-install-torch-tensorrt-for-jetson-agx-orin/335168 "2025-06-04T06:08:51Z")\ **Posts on this page:** 6\ **Page:** 1
**Author:** ![2128879921](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@2128879921](https://forums.developer.nvidia.com/u/2128879921)\ **Post date:** [June 4, 2025, 6:08am UTC](https://forums.developer.nvidia.com/t/how-to-install-torch-tensorrt-for-jetson-agx-orin/335168/1 "2025-06-04T06:08:51Z")
i have install torch2.7.0 aarch64 … from [jp6/cu126 index](https://pypi.jetson-ai-lab.dev/jp6/cu126),but i have problem to install torch\_tensorrt. i am rookie, is it must to use bazel?? my system :Jetpack6.2[L4T 36.4.3],Ubuntu 22.04, CUDA 12.6,TensorRT 10.3,torch 2.7 have been installed. i use anaconda. thank for you answer.~.~ ---
**Author:** ![AastaLLL](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/aastalll/32/14043_2.png) [@AastaLLL](https://forums.developer.nvidia.com/u/AastaLLL)\ **Post date:** [June 4, 2025, 9:57am UTC](https://forums.developer.nvidia.com/t/how-to-install-torch-tensorrt-for-jetson-agx-orin/335168/3 "2025-06-04T09:57:11Z")
Hi, Is torch2trt an option for you? Our team has tried to install torch\_tensorrt but some issues. However, torch\_trt seems to work on JetPack 6.1 and 6.2. > > > Hi, > I want to create an docker image with PyTorch, Torchvision, ONNX Runtime GP…U and torch\_tensorrt to use TensorRT on the Nvidia Jetson Orin Nano with Jet Pack 6.1. > From your latest docker image name \*\*dustynv/l4t-pytorch:r36.4.0\*\*, I have managed to install: > \- torch (2.5.0) > \- torchvision (0.20.0) > \- onnxruntime-gpu (1.20.0) > for cuda 12.6 and Python 3.10. > > I run some tests and I'm able to run some torch models or onnx models, both, in the CPU and the GPU. > > However, I was not able to install \*\*torch\_tensorrt\*\* following and adapting your code from this \[Dockerfile\](https://github.com/dusty-nv/jetson-containers/blob/master/packages/pytorch/torch\_tensorrt/Dockerfile) for Jet Pack 4.6. > Have some insights to install \*\*torch\_tensorrt\*\* on Jet Pack 6.1 ? > > Moreover, I saw \*\*torch2trt\*\* is already installed in the \*\*dustynv/l4t-pytorch:r36.4.0\*\* docker image. I did not really understood the difference between \*\*torch2trt\*\* and \*\*torch\_tensorrt\*\*. It looks like \*\*torch2trt\*\* is for edge devices but it is not updated since 8 months. Which one is better to use for Nvidia Jetson Orin Nano with Jet Pack 6.1 and which one has the lowest inference time latency? > > Thanks for sharing you docker images Thanks. ---
**Author:** ![2128879921](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@2128879921](https://forums.developer.nvidia.com/u/2128879921)\ **Post date:** [June 5, 2025, 2:43am UTC](https://forums.developer.nvidia.com/t/how-to-install-torch-tensorrt-for-jetson-agx-orin/335168/4 "2025-06-05T02:43:16Z")
thank for yor reply. But I try to use torch2trt have some problem about my model. I see some torch-tensorrt from this [[Build and test Linux aarch64 wheels for Jetpack · Workflow runs · pytorch/TensorRT · GitHub](https://github.com/pytorch/TensorRT/actions/workflows/build-test-linux-aarch64-jetpack.yml)]. Or lower Jetpack is ok for torch-tensorrt? Thanks. ---
**Author:** ![AastaLLL](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/aastalll/32/14043_2.png) [@AastaLLL](https://forums.developer.nvidia.com/u/AastaLLL)\ **Post date:** [June 5, 2025, 7:11am UTC](https://forums.developer.nvidia.com/t/how-to-install-torch-tensorrt-for-jetson-agx-orin/335168/5 "2025-06-05T07:11:53Z")
Hi, The latest container for torch\_tensor is based on r35 which is JetPack 5. Is this okay for you? Thanks. ---
**Author:** ![2128879921](https://developer.download.nvidia.com/images/forums/profile-default-devtalk-84.png) [@2128879921](https://forums.developer.nvidia.com/u/2128879921)\ **Post date:** [June 5, 2025, 1:13pm UTC](https://forums.developer.nvidia.com/t/how-to-install-torch-tensorrt-for-jetson-agx-orin/335168/6 "2025-06-05T13:13:49Z")
thank you, my jetson master. i will try it ---
**Author:** ![system](https://sea2.discourse-cdn.com/nvidia/user_avatar/forums.developer.nvidia.com/system/32/68080_2.png) [@system](https://forums.developer.nvidia.com/u/system)\ **Post date:** [July 1, 2025, 7:33am UTC](https://forums.developer.nvidia.com/t/how-to-install-torch-tensorrt-for-jetson-agx-orin/335168/8 "2025-07-01T07:33:03Z")
Closed on July 1, 2025, 7:33am UTC This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.