Hi, I currently have a Jetson Orin Nano with: Jetpack - 6.0 CUDA - 12.2 Python - 3.10 Torch Version - 2.4.0a0+07cecf4168.nv24.05 TensorRT - 10.2 Torch2trt - 0.5.0 At the moment I have a pytorch model which runs slower than expected. I want to use a TensorRT engine to speed up. I tried both: …

Hi, I was able to write a code from the TRT documentation! Thanks for your support.

Jetson Orin Nano TensorRT

Robotics & Edge Computing Jetson & Embedded Systems Jetson Orin Nano

prp852 July 29, 2024, 7:34am 5

Hi,
Thank you so much for your reply!

Long story short, something messed up and I ended up with this error.

I am now using another GPU (CUDA 12.5) and can convert ONNX to TensorRT
Is there a code or documentation I can refer on how to use the “.trt” file to run inference?

Thanks again :))

Topic		Replies	Views
Inference error while using tensorrt engine on jetson nano TensorRT tensorrt	3	1780	February 1, 2022
Trouble with TensorRT inference pipeline for Segmentation on Jetson Orin Nano Jetson Orin Nano tensorrt	5	35	June 18, 2025
TensorRT problem on NVIDIA APEX ORIN NX TensorRT tensorrt , jetson-inference , cudnn	1	41	August 29, 2024
Error Code 3: API Usage Error condition: std::isfinite(beta) Jetson Orin Nano tensorrt , jetson-inference , cudnn , onnx	8	416	March 25, 2024
Engine Plan Inference on JetsonTX2 Jetson TX2 tensorrt , python	11	1850	October 18, 2021
TensorRT deployment with engine generated from TLT example TensorRT tensorrt	8	777	December 5, 2020
Converting FCN8-ResNet18 from Pytorch to TensorRT for inference on Jetson Nano TensorRT tensorrt , jetson-inference , pytorch , python , onnx	3	2277	October 12, 2021
Inference on TensorRT engine with trtexec TensorRT tensorrt , jetson-inference , pytorch , cudnn , onnx	1	1617	March 30, 2024
How to use .trt file for inference on jetson nano Jetson Nano tensorrt	4	1538	October 18, 2021
Inference error while using tensorrt engine on jetson nano Jetson Nano tensorrt , nvbugs	23	3672	April 20, 2022

Jetson Orin Nano TensorRT

Related topics