How to Install Torch_TensorRT for Jetson AGX ORIN

i have install torch2.7.0 aarch64 … from jp6/cu126 index,but i have problem to install torch_tensorrt. i am rookie, is it must to use bazel?? my system :Jetpack6.2[L4T 36.4.3],Ubuntu 22.04, CUDA 12.6,TensorRT 10.3,torch 2.7 have been installed. i use anaconda. thank for you answer.~.~

Hi,

Is torch2trt an option for you?

Our team has tried to install torch_tensorrt but some issues.
However, torch_trt seems to work on JetPack 6.1 and 6.2.

Thanks.

thank for yor reply. But I try to use torch2trt have some problem about my model. I see some torch-tensorrt from this [Build and test Linux aarch64 wheels for Jetpack · Workflow runs · pytorch/TensorRT · GitHub]. Or lower Jetpack is ok for torch-tensorrt? Thanks.

Hi,

The latest container for torch_tensor is based on r35 which is JetPack 5.
Is this okay for you?

Thanks.

1 Like

thank you, my jetson master. i will try it

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.