Cannot get the playback rtsp stream for deepstream yolo and do inference

827511148 · June 4, 2020, 7:04am

Please provide complete information as applicable to your setup.

• Jetson AGX Xavier (Jetson / GPU)
• DeepStream 4.0.2
• JetPack Version (valid for Jetson only)
• TensorRT Version
• NVIDIA GPU Driver Version (valid for GPU only)

Hi I am now confused by somthing about rtsp setting in Source Grop

I have two rtsp streams, the first one is an live source from a camera, the stream format is rtsp://admin:password01!@192.168.9.199/h264/ch41/sub/av_stream.
The second is an playback rtsp stream from an NVR like rtsp://admin:password01!@192.168.198.51:554/Streaming/tracks/701?starttime=20200603T153900Z&endtime=20200603T155500Z, both codec are H264, and I can play two streams with VLC or Potplayer with no error occur. but only the live source can be acquired and do the inference. The playback streams will get an FPS of 0 and a black screen, no other errors occur.

log of running playback rtsp stream and the config file

change to live source rtsp it will run well

Could you help with this, two streams have the same setting expect one is live source from camera and one is playback from NVR. Thank you.

DaneLLL · June 4, 2020, 8:28am

Hi,
You may check if the second IR is valid. Please run

gst-launch-1.0 uridecodebin uri=rtsp://admin:password01!@192.168.198.51:554/Streaming/tracks/701?starttime=20200603T153900Z&endtime=20200603T155500Z ! nvoverlaysink

If it fails to run, you need to figure out the URI which can be played through uridecodebin.

827511148 · June 4, 2020, 11:58am

Hi Danel, thank you for your reply. I run the command you told me, and I got the log like this.

log for playback rtsp stream with the problem I have told.

and the live camera stream log with no error.

It seems both of them are the same. So could you give me futher help?
By the way, You said I need to figure out the URI which can be played through uridecodebin. Does it mean some rtsp cannot played by uridecodebin? My two streams are same on paramas setting expect one is live camera and the other is playback from NVR. Does deepstream have some special limit for playback rtsp streams? Thank you.

DaneLLL · June 4, 2020, 3:11pm

Hi,
The log looks incomplete. Do you see video playback shown on screen?

827511148 · June 5, 2020, 2:39am

Hi,
I test as you told me. the live camera source can playback on screen. but the NVR streams have no window shown on screen, the log of two streams are same as former replay. But I am sure that both streams can played by several media players such as VLC and Potplayer. So is there any solutions of this? Does uridecodebin have some limit for playback streams from NVR?

log and screen for live camera stream

log and screen for NVR playback stream

Thank you.

DaneLLL · June 5, 2020, 5:44am

Hi,
It may be similar to

The video stream is not compressed form NV12.

827511148 · June 5, 2020, 9:43am

Hi, thank you for your reply. But I have checked the stream info of my playback rtsp stream. The format is NV12, not RGB or BGR. Could it be some other reason?

The stream info is below. the media player is Potplayer

DaneLLL · June 8, 2020, 8:13am

Hi,
Please run

$ export GST_DEBUG=*FACTORY*:4
$ gst-launch-1.0 uridecodebin uri=rtsp://admin:password01!@192.168.198.51:554/Streaming/tracks/701?starttime=20200603T153900Z&endtime=20200603T155500Z ! nvoverlaysink sync=false

And share which elements are picked by uridecodebin.

827511148 · June 8, 2020, 11:28am

Hi,
Thanks for your reply, I run the command, and the log are below.

DaneLLL · June 9, 2020, 7:45am

Hi,
Please run the command and share us the h264 stream(5~10 seconds) for further check.

$ gst-launch-1.0 rtspsrc location=rtsp://admin:password01!@192.168.198.51:554/Streaming/tracks/701?starttime=20200603T153900Z&endtime=20200603T155500Z ! rtph264depay ! h264parse ! video/x-h264,stream-format=byte-stream ! filesink location=a.h264

827511148 · June 9, 2020, 12:54pm

Hi Danel,
Thanks for your reply. I run the command but have an error, so no a.h264 streams are created. Here is the log. What can I do for your futher debug? Thank you for your help. Hope for your reply.

DaneLLL · June 9, 2020, 11:25pm

Hi,
Please break down the pipeline and try.

$ gst-launch-1.0 rtspsrc location=rtsp://admin:password01!@192.168.198.51:554/Streaming/tracks/701?starttime=20200603T153900Z&endtime=20200603T155500Z ! fakesink
$ gst-launch-1.0 rtspsrc location=rtsp://admin:password01!@192.168.198.51:554/Streaming/tracks/701?starttime=20200603T153900Z&endtime=20200603T155500Z ! rtph264depay ! fakesink
$ gst-launch-1.0 rtspsrc location=rtsp://admin:password01!@192.168.198.51:554/Streaming/tracks/701?starttime=20200603T153900Z&endtime=20200603T155500Z ! rtph264depay ! h264parse ! video/x-h264,stream-format=byte-stream ! fakesink

827511148 · June 10, 2020, 12:56am

Hi,
The log of these three commad are below.

gst-launch-1.0 rtspsrc location=rtsp://admin:password01!@192.168.198.51:554/Streaming/tracks/701?starttime=20200603T153900Z&endtime=20200603T155500Z ! fakesink

gst-launch-1.0 rtspsrc location=rtsp://admin:password01!@192.168.198.51:554/Streaming/tracks/701?starttime=20200603T153900Z&endtime=20200603T155500Z ! rtph264depay ! fakesink

gst-launch-1.0 rtspsrc location=rtsp://admin:password01!@192.168.198.51:554/Streaming/tracks/701?starttime=20200603T153900Z&endtime=20200603T155500Z ! rtph264depay ! h264parse ! video/x-h264,stream-format=byte-stream ! fakesink

None of them have a playblack on the screen. Thank you for your help, looking foward for your reply.

DaneLLL · June 10, 2020, 8:09am

Hi,
Looks lile the URI is invalid. You need to work out a URI which can be run with rtspsrc.

We are able to dump the h264 stream in running with a public RTSP source:

$ gst-launch-1.0 rtspsrc location=rtsp://wowzaec2demo.streamlock.net/vod/mp4:BigBuckBunny_115k.mov ! rtph264depay ! h264parse ! video/x-h264,stream-format=byte-stream ! filesink location=a.h264

827511148 · June 10, 2020, 9:20am

Hi,
Thanks for your reply. Is there any special limit for a RTSP URI run with rtspsrc? We also have streams whhich can be played by both of these commads. Those are streams from live camera. But this streams from NVR playback cannot run by these command. Note that both streams from NVR or live camera can be played by VLC and Potplayer. Does it mean rtspsrc doen’t support these NVR playback streams?

DaneLLL · June 11, 2020, 4:26am

Hi,
You would need to figure out a valid URI which can be launnched through rtspsrc, or you are not able to leverage DeepStream SDK. May see if other users can share experience of using NVR.