VST got Black Screen & 0 FPS in DeepStream

[patrick.hou]

• Hardware：Jetson Orin Nano 8GB
• JetPack Version：6.2 [L4T 36.4.3]
• AI NVR Version：2.0.1
• VST Version：1.3.0-24.07.1
• DeepStream Version：7.1

I followed the process in the Jetson Platform Services documentation to start the AI NVR, but I encountered the following two issues:

• The sensor status in VST appears normal, but the stream shows a black screen. After a while, the message “Peer connection is successful but VST UI is not receiving frames” appears.
• DeepStream detects the sensor, but the FPS remains at 0.

I have tried both live RTSP stream and using Nvstreamer to play prerecorded videos, but both have the same issue.

When I use gst-launch-1.0 to open the VST proxy URL, it works fine.
At the moment, I have no clue where the problem is coming from.

Below are the logs from VST and DeepStream.

deepstream.log (6.5 MB)
vst.log (96.6 MB)

[kesong]

@patrick.hou

When I use gst-launch-1.0 to open the VST proxy URL, it works fine.

Can you share the command line which works fine with your original URL? We can have a try if setting to TCP protocol in rtspsrc GStreamer plugin can work.

[patrick.hou]

This is my command.
Use original URL.

gst-launch-1.0 rtspsrc location=rtsp://admin:admin@10.0.0.146:554/ch01/0 ! decodebin ! autovideosink

gst-launch-1.0 rtspsrc location=rtsp://admin:AAEONiot2017@10.0.0.135:554/ch01/1 ! decodebin ! autovideosink

---

Use VST proxy URL.

gst-launch-1.0 rtspsrc location=rtsp://10.0.0.138:8554/live/57518e7f-051c-454d-8bb7-384e48d7bae9 ! decodebin ! autovideosink

[kesong]

Do you have any camera which works fine in VST? We have the supported cameras in VST here: VST — Jetson Platform Services documentation. Can you compare the VST log between the camera works and don’t works?

[patrick.hou]

I currently don’t have any camera that works on VST. I’m running on Jetson Nano 8GB with JetPack 6.2.

However, I have another device, a Jetson Xavier NX 16GB with JetPack 6.0, where all my cameras work fine. I’ve compared the logs and noticed some GStreamer-related errors—these are shown in the logs attached in the previous comment. But when I test the GStreamer commands separately, everything runs normally. At the moment, I have no clue where the issue lies.

My cameras are EverFocus EBN series IP cams.
EBN1240-A & EBN1840-A15.

[kesong]

Orin Nano haven’t HW video encoder. Can you check below setting in your setup? Here is the setting document of VST: VST Config — Jetson Platform Services documentation
VST configure file: /opt/nvidia/jetson-2.0.0/services/vst/config/vst_config.json

"use_webrtc_inbuilt_encoder": "h264"

[patrick.hou]

I’ve checked the configuration, and the setting is indeed "use_webrtc_inbuilt_encoder": "h264"

[patrick.hou]

I’ve tried downgrading to JetPack 6.0, and everything works fine with VST and DeepStream.
However, it’s still not working on JetPack 6.2.

[kesong]

Can you share the VST version when you downgrading to JetPack 6.0?

[patrick.hou]

VST 1.2.58 on JetPack 6.0
VST 1.3.0-24.07.1 on JetPack 6.2

[kesong]

Can you have a try set below setting in vst file: /opt/nvidia/jetson-2.0.0/services/vst/config/vst_config.json
“use_software_path”: true,

[patrick.hou]

Changing this parameter worked! Now my VST can properly display both live and playback streams—thank you so much!
However, my DeepStream inference is still running at 0 FPS. Are there any other configuration files or parameters I should modify as well?

[kesong]

Which compose are you using? Do you have any modifications of the config file?

$ ls ai_nvr
base_compose.yaml  compose_agx.yaml  compose_agx_yolov8s.yaml  compose_nano.yaml  compose_nx16.yaml  compose_nx16_yolov8s.yaml  compose_nx8.yaml

[patrick.hou]

I am using compose_nano.yaml, and I haven’t made any modifications to it. The attached file is my compose configuration file.
compose_nano.zip (1.6 KB)

[kesong]

Can you share the log of deepstream container?

[patrick.hou]

No problem, the attached file is my log.
deepstream.log (32.2 MB)
sdr-deepstream.log (355.3 KB)

[kesong]

I found below error log in your deepstream.log. Seems your camera can’t use NV HW video decoder. Your command line selected SW video decoder.

no suitable plugins found:
Missing decoder: H.264 (Baseline Profile) (video/x-h264, stream-format=(string)avc, alignment=(string)au, codec_data=(buffer)0142001fffe1000f6742001f963540a00b74dc0404040801000468ce3c80, level=(string)3.1, profile=(string)baseline, width=(int)1280, height=(int)720, framerate=(fraction)0/1, chroma-format=(string)4:2:0, bit-depth-luma=(uint)8, bit-depth-chroma=(uint)8, colorimetry=(string)1:3:5:1, parsed=(boolean)true)
nvmultiurisrcbin ERROR from element udpsrc0: Internal data stream error.

[yingliu]

There is no update from you for a period, assuming this is not an issue anymore. Hence we are closing this topic. If need further support, please open a new one. Thanks