Hi, we have upgraded some of our Jetsons to JetPack 5.1 from JetPack 4.6 and noticed substantial latency spikes when running our pytorch-based object detector. Since we are unable to share our detector, we used Yolov7 for this post. detector.zip (204.9 KB) Base docker image on JetPack 4.6 was: n…

Hi, Do you meet the same issue? This topic can get good performance on JetPack 5 but hit the longer latency occasionality. Thanks.

Since I’m a new user, I could not add more than one link in the post so here they are: links.txt (260 Bytes)

Hi, Have you maximized the device performance first? $ sudo nvpmodel -m 0 $ sudo jetson_clocks More, please noted that the TensorRT engine needs to be regenerated on JetPack 5.1. Thanks.

Hi, Thank you for the answer. We actually use nvpmodel 8 as it has 20W 6 core setup. Your suggestion turned off 4/6 CPU cores, but that did not influence the performance. We also have jetson_clocks inactive on Jetpack 4.6, and we don’t observe latency spikes there. [latency_spikes] In the meanti…

Hi, Just want to confirm first. The environment for Xavier NX outside of the container is also JetPack 5.1, is that correct? Thanks.

Yes, that is true. It would throw error when trying to run the code otherwise as we found out that r32 and r35 images can’t be run on Jetpack they aren’t designed for.

Hi, Could you also help to check if the latency is stable without using a container? Thanks.

Hi, At the moment we don’t want to install stuff on the device and would like to use official Nvidia containers. Did you manage to reproduce the issue?

I’d like to attach the minimal working example here with the instructions in the Readme file: detector_latency_test.zip (1.1 MB)

Hi, Thanks for sharing the example. Will get back to you later. Thanks.

Hi, We tested the minimal working example on XavierNX with JetPack 5.1 but cannot reproduce the issue. Repeat several times with nvpmodel 8 and jetson_clocks, the latency output is between 0.03~0.04, with no value > 0.05. Thanks.

High detection latency on Jetpack 5.1

Robotics & Edge Computing Jetson Systems Jetson Xavier NX

AastaLLL March 22, 2023, 8:21am 17

Hi,

Confirmed that we can reproduce the issue with jtop run concurrently.

We are discussing this with our internal team.
Will share more information with you later.

Thanks.

Jetpack 5.1.2 performance degredation

Topic		Replies	Views
High detection latency on Jetpack 5.1 Jetson Xavier NX pytorch	1	484	March 8, 2023
Performance issues when upgrading to JetPack 5 Jetson Xavier NX jetpack , performance	12	514	October 23, 2024
Jetpack 5 Series slow performance Jetson Xavier NX performance	16	2045	June 26, 2023
Slowdown in nvdec when upgrading to JetPack 5.1.2 DeepStream SDK jetpack , decoder , gstreamer , jetson	9	958	May 16, 2024
JetPack 5.1.3/L4T 35.5.0 is now live Jetson Xavier NX	6	3284	April 17, 2025
JetPack 5.1.1 is now live Jetson Xavier NX	15	4140	June 7, 2023
Nvidia jetson detectnet increasing latency Jetson Nano jetson-inference , ai	8	1932	September 29, 2021
High latency in rtspout stream in DS-5.1 DeepStream SDK gstreamer , ffmpeg	5	1052	April 29, 2021
Jetpack Vision for Deeplearning issue Jetson AGX Xavier	6	694	August 30, 2019
Tenorrt模型推理速度，使用jetpack6.2比使用jetpack5.1慢了很多 Jetson AGX Orin tensorrt , chinese	3	208	May 7, 2025

High detection latency on Jetpack 5.1

Related topics