So much more latency on Deepstream 6, what did I miss?

Please provide complete information as applicable to your setup.

• Hardware Platform Jetson AGX Orin
• DeepStream Version 6.2
• JetPack Version L4T 35.2.1
• Issue Type question

Dear community,

I have a Deepstream app that I developed on a Jetson AGX Xavier that has Deepstream 5.1 installed on it.
The app receives a video stream through RTSP from a camera, runs some human detection, commands the camera’s gimbal to follow the human, run some pose estimation and action recognition on it, adds some OSD, displays everything on a monitor, and saves the whole as an mkv file.
The difference between my moving in front of the camera and moving on the display is about 0.5 seconds.

Today I have a Jetson AGX Orin with Deepstream 6.2 installed on it and I’m trying to have this app run on it.
After a lot of work to get the models to run on it, the app runs, but there is now a 10 seconds difference between what happens in front of the camera and what is displayed on the screen.
Apart from the models, I didn’t touch the code of the app.

Should I somehow convert my pipeline from a deepstream 5.1 app to a deepstream 6.2 ?

I was expecting to reduce the latency with this new hardware and software, as I had some lags due to the action recognition on the Xavier and it was messing the following of the people, but now it’s utterly unusable.

I’m all ears as to what I missed and what I could do to fix this.

Thank you in advance for your help

Have you monitor the GPU performance when you run the app in AGX Orin and DeepStream 6.2?


Thank you for the hint, and sorry for the long time I took to reply, I was on a 3 weeks vacation trip.
I will monitor the GPU and get back here with the results as soon as I can get back to the workshop.