Optimizing ViewPro IP Camera Streaming on Jetson Orin NX

Accelerated Computing Intelligent Video Analytics DeepStream SDK
, ,
1

• Hardware Platform (Jetson / GPU):
Jetson Orin NX

• DeepStream Version:
DeepStream 6.3

• JetPack Version (valid for Jetson only):
JetPack 5.1.3

• Issue Type (questions, new requirements, bugs):
Questions regarding lag issue when streaming from ViewPro IP Camera.

I am using the ViewPro IP Camera with RTSP stream on Jetson Orin NX. The camera outputs video in H.264/H.265 at 720p/1080p and 25fps. When trying to process the stream through DeepStream 6.3, I experience a lag between frames. The typical pipeline used is rtspsrc + decodebin or uridecodbin, but I still face delays.

I’ve also tried using FFmpeg in Python with the following setup to minimize lag:

process = (
ffmpeg
.input(uri, rtsp_transport=‘tcp’, fflags=‘nobuffer’, flags=‘low_delay’, analyzeduration=‘1’)
.output(‘pipe:’, format=‘rawvideo’, pix_fmt=‘bgr24’)
.overwrite_output()
.run_async(pipe_stdout=True)
)

This setup works but is not ideal for integration into DeepStream due to the need for better optimization for GPU processing.

I am seeking guidance on reducing or eliminating lag in the video stream when using DeepStream to process RTSP streams from the ViewPro IP Camera. Specifically, I would like to know if there are any particular plugins or optimizations to improve the performance and reduce latency when using the rtspsrc, decodebin, or uridecodbin plugins, or if another approach or plugin would be more efficient.

I would appreciate suggestions or advice from anyone familiar with optimizing video streams in DeepStream on Jetson Orin NX for real-time processing.

3

If the camera’s stream is the standard RTSP RFC 2326 - Real Time Streaming Protocol (RTSP) stream, you can use GStreamer rtspsrc plugin as the source plugin.The ffmpeg command show that the camera support TCP connection. You can set the " protocols" property of rtspsrc as 4 and set the " latency" property of rtspsrc as less as possible.

You can use nvv4l2decoder as the hardware decoder of the ES stream from the rtsp. If the camera’s stream has only I and P frames and no B frame. You can set “disable-dpb” and “low-latency-mode” properties of nvv4l2decoder as TRUE.

4

There is no update from you for a period, assuming this is not an issue anymore. Hence we are closing this topic. If need further support, please open a new one. Thanks

5

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.