Low latency video stream from gstreamer pipeline on jetson TX2

Robotics & Edge Computing Jetson & Embedded Systems Jetson TX2
1

hi,
I want to video stream and capture with use to gstreamer pipelines on my digital camera. I use this pipeline:
v4l2src device=/dev/video8 io-mode=2 ! video/x-raw, width=640, height=480,framerate=60/1 ! nvvidconv ! omxh264enc bitrate=1000000 ! mpegtsmux name=mux ! udpsink host=235.6.6.6 auto-multicast=true port=11002 ---> for video stream

udpsrc multicast-group = 235.6.6.6 auto-multicast=true port=11002 ! tsdemux ! video/x-h264 ! queue ! h264parse disable-passthrough=true ! avdec_h264 ! videoconvert ! video/x-raw, format=BGRA ! appsink name=outsink ---> for video receiver
These pipelines correctly works, but my video camera stream is low latency. I have a delay of at least 2 seconds.
How can i make the video stream real time?

3

Hi,
We have deprecated omx plugins. Please use nvv4l2h264enc. You can set the properties and try:

... ! nvv4l2h264enc insert-sps-pps=1 maxperf-enable=1 idrinterval=15 poc-type=2 !
4

Hi DaneLLL,
I tried this pipeline:

gst-launch-1.0 v4l2src  device=/dev/video8 io-mode=2  ! video/x-raw, width=640, height=480,framerate=60/1 ! nvvidconv ! nvv4l2h264enc insert-sps-pps=1 maxperf-enable=1 idrinterval=15 poc-type=2 ! mpegtsmux name=mux  ! udpsink host=235.6.6.6 auto-multicast=true port=11002

But I got this output:

WARNING: erroneous pipeline: no property "idrinterval" in element "nvv4l2h264enc0"

When remove idrinterval andpoc-type=2, :

gst-launch-1.0 v4l2src  device=/dev/video8 io-mode=2  ! video/x-raw, width=640, height=480,framerate=60/1 ! nvvidconv ! nvv4l2h264enc insert-sps-pps=1 maxperf-enable=1 ! mpegtsmux name=mux  ! udpsink host=235.6.6.6 auto-multicast=true port=11002

This pipeline is runable. But still the video stream has the same delay

1 Like
5

Hi,
Looks like you don’t use latest r32.5.1(Jetpack 4.5.1). Please share the release version:

$ head -1 /etc/nv_tegra_release

Please check glass-to-glass latency of the v4l2 source. In most cases, the latency is mainly from the source. Generally hardware encoding does not give much latency.

6

My jetpack version is 4.4.1.
Commond output:

R32 (realise) REVISION 4.3 BOARD=186ref EAI=aarch64
7

Hi,
The property idrinterval is added in r32.5.1. The source code of gst-v4l2 is public. You can build prebuilt lib from r32.5.1 source code and replace it to r32.4.3.

For setting poc-type, would need to upgrade to r32.5.1.

8

Hi Danell,
Is there any other way to speed it up video stream without update? Because I work on offline jetson system. I don’t have internet communication. Actually, I’m afraid to disrupt the working system

9

Hi,
You may check glass-to-glass latency first. If the latency is from source, may check to reduce it.

Since video decoding begins from IDR frames, setting small idrinterval should help. For idrinterval=15 in 30 fps, the theoretical latency is around 500-600ms.

11

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.