Does nvmultiurisrcbin or nvurisrcbin not work in jetson?

Accelerated Computing Intelligent Video Analytics DeepStream SDK
,
1

Please provide complete information as applicable to your setup.

**• Hardware Platform Jetson Orin AGX 32GB * *
• DeepStream-6.4
• JetPack Version 6.0+b106 ( linux 36.3)
• TensorRT Version
• NVIDIA GPU Driver Version 8.6.2.3-1+cuda12.2
• quetsion

Hello NVIDIA DeepStream Team,

I am experiencing an issue with DeepStream-6.4 on a Jetson Orin AGX 32GB running JetPack 6.0+b106. I would like to seek assistance regarding the problem described below.

Environment Details

  • Device: Jetson Orin AGX 32GB
  • JetPack Version: 6.0+b106
  • DeepStream Version: 6.4
  • Operating System: Ubuntu-based (JetPack)
  • Input Source: RTSP Streams

Issue Description

1. Successful Test:

  • Running deepstream-test1 executes without any issues.

2. Failing Tests:

  • When executing deepstream-test3 or deepstream-test5 with RTSP as the input source, the following error occurs:
Stream format not found, dropping the frame

However, the same RTSP streams work perfectly fine when accessed using VLC or ffplay.

3. GStreamer Pipeline Tests:

Using nvurisrcbin:

gst-launch-1.0 -v \
  nvurisrcbin uri=rtsp://myrtspip:8555/falldown ! \
  nvv4l2decoder ! \
  nvvidconv ! \
  nveglglessink

This results in the error:

/GstPipeline:pipeline0/GstDsNvUriSrcBin:dsnvurisrcbin0/GstTee:tee_rtsp_pre_decode.GstPad:sink: caps = video/x-h264, stream-format=(string)avc, alignment=(string)au, codec_data=(buffer)01640028ffe1001b67640028acb200f0044fcb8088000003000800000301e078c1924001000668ebc3cb22c0, level=(string)4, profile=(string)high, pixel-aspect-ratio=(fraction)1/1, width=(int)1920, height=(int)1080, framerate=(fraction)30/1, chroma-format=(string)4:2:0, bit-depth-luma=(uint)8, bit-depth-chroma=(uint)8, parsed=(boolean)true
/GstPipeline:pipeline0/GstDsNvUriSrcBin:dsnvurisrcbin0/GstH264Parse:parser.GstPad:sink: caps = video/x-h264, stream-format=(string)avc, alignment=(string)au, codec_data=(buffer)01640028ffe1001b67640028acb200f0044fcb8088000003000800000301e078c1924001000668ebc3cb22c0, level=(string)4, profile=(string)high
/GstPipeline:pipeline0/GstDsNvUriSrcBin:dsnvurisrcbin0/GstDecodeBin:decodebin.GstGhostPad:sink.GstProxyPad:proxypad8: caps = video/x-h264, stream-format=(string)avc, alignment=(string)au, codec_data=(buffer)01640028ffe1001b67640028acb200f0044fcb8088000003000800000301e078c1924001000668ebc3cb22c0, level=(string)4, profile=(string)high, pixel-aspect-ratio=(fraction)1/1, width=(int)1920, height=(int)1080, framerate=(fraction)30/1, chroma-format=(string)4:2:0, bit-depth-luma=(uint)8, bit-depth-chroma=(uint)8, parsed=(boolean)true
/GstPipeline:pipeline0/GstDsNvUriSrcBin:dsnvurisrcbin0/GstDecodeBin:decodebin/GstTypeFindElement:typefind.GstPad:src: caps = video/x-h264, stream-format=(string)avc, alignment=(string)au, codec_data=(buffer)01640028ffe1001b67640028acb200f0044fcb8088000003000800000301e078c1924001000668ebc3cb22c0, level=(string)4, profile=(string)high, pixel-aspect-ratio=(fraction)1/1, width=(int)1920, height=(int)1080, framerate=(fraction)30/1, chroma-format=(string)4:2:0, bit-depth-luma=(uint)8, bit-depth-chroma=(uint)8, parsed=(boolean)true
/GstPipeline:pipeline0/GstDsNvUriSrcBin:dsnvurisrcbin0/GstDecodeBin:decodebin/GstH264Parse:h264parse0: config-interval = -1
/GstPipeline:pipeline0/GstDsNvUriSrcBin:dsnvurisrcbin0/GstDecodeBin:decodebin/GstH264Parse:h264parse0.GstPad:sink: caps = video/x-h264, stream-format=(string)avc, alignment=(string)au, codec_data=(buffer)01640028ffe1001b67640028acb200f0044fcb8088000003000800000301e078c1924001000668ebc3cb22c0, level=(string)4, profile=(string)high, pixel-aspect-ratio=(fraction)1/1, width=(int)1920, height=(int)1080, framerate=(fraction)30/1, chroma-format=(string)4:2:0, bit-depth-luma=(uint)8, bit-depth-chroma=(uint)8, parsed=(boolean)true
/GstPipeline:pipeline0/GstDsNvUriSrcBin:dsnvurisrcbin0/GstDecodeBin:decodebin/GstTypeFindElement:typefind.GstPad:sink: caps = video/x-h264, stream-format=(string)avc, alignment=(string)au, codec_data=(buffer)01640028ffe1001b67640028acb200f0044fcb8088000003000800000301e078c1924001000668ebc3cb22c0, level=(string)4, profile=(string)high, pixel-aspect-ratio=(fraction)1/1, width=(int)1920, height=(int)1080, framerate=(fraction)30/1, chroma-format=(string)4:2:0, bit-depth-luma=(uint)8, bit-depth-chroma=(uint)8, parsed=(boolean)true
/GstPipeline:pipeline0/GstDsNvUriSrcBin:dsnvurisrcbin0/GstDecodeBin:decodebin.GstGhostPad:sink: caps = video/x-h264, stream-format=(string)avc, alignment=(string)au, codec_data=(buffer)01640028ffe1001b67640028acb200f0044fcb8088000003000800000301e078c1924001000668ebc3cb22c0, level=(string)4, profile=(string)high, pixel-aspect-ratio=(fraction)1/1, width=(int)1920, height=(int)1080, framerate=(fraction)30/1, chroma-format=(string)4:2:0, bit-depth-luma=(uint)8, bit-depth-chroma=(uint)8, parsed=(boolean)true
/GstPipeline:pipeline0/GstDsNvUriSrcBin:dsnvurisrcbin0/GstRtpH264Depay:depay.GstPad:sink: caps = application/x-rtp, media=(string)video, payload=(int)96, clock-rate=(int)90000, encoding-name=(string)H264, packetization-mode=(string)1, profile-level-id=(string)640028, sprop-parameter-sets=(string)"Z2QAKKyyAPAET8uAiAAAAwAIAAADAeB4wZJA\,aOvDyyLA", ssrc=(uint)2522459870, clock-base=(uint)593052021, seqnum-base=(uint)7727, npt-start=(guint64)0, play-speed=(double)1, play-scale=(double)1, onvif-mode=(boolean)false
/GstPipeline:pipeline0/GstDsNvUriSrcBin:dsnvurisrcbin0/GstRTSPSrc:src.GstGhostPad:recv_rtp_src_0_2522459870_96.GstProxyPad:proxypad7: caps = application/x-rtp, media=(string)video, payload=(int)96, clock-rate=(int)90000, encoding-name=(string)H264, packetization-mode=(string)1, profile-level-id=(string)640028, sprop-parameter-sets=(string)"Z2QAKKyyAPAET8uAiAAAAwAIAAADAeB4wZJA\,aOvDyyLA", ssrc=(uint)2522459870, clock-base=(uint)593052021, seqnum-base=(uint)7727, npt-start=(guint64)0, play-speed=(double)1, play-scale=(double)1, onvif-mode=(boolean)false
/GstPipeline:pipeline0/GstDsNvUriSrcBin:dsnvurisrcbin0/GstRTSPSrc:src/GstRtpBin:manager.GstGhostPad:recv_rtp_src_0_2522459870_96.GstProxyPad:proxypad6: caps = application/x-rtp, media=(string)video, payload=(int)96, clock-rate=(int)90000, encoding-name=(string)H264, packetization-mode=(string)1, profile-level-id=(string)640028, sprop-parameter-sets=(string)"Z2QAKKyyAPAET8uAiAAAAwAIAAADAeB4wZJA\,aOvDyyLA", ssrc=(uint)2522459870, clock-base=(uint)593052021, seqnum-base=(uint)7727, npt-start=(guint64)0, play-speed=(double)1, play-scale=(double)1, onvif-mode=(boolean)false
/GstPipeline:pipeline0/GstDsNvUriSrcBin:dsnvurisrcbin0/GstDecodeBin:decodebin/GstH264Parse:h264parse0.GstPad:src: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, level=(string)4, profile=(string)high, pixel-aspect-ratio=(fraction)1/1, width=(int)1920, height=(int)1080, framerate=(fraction)30/1, chroma-format=(string)4:2:0, bit-depth-luma=(uint)8, bit-depth-chroma=(uint)8, parsed=(boolean)true
/GstPipeline:pipeline0/GstDsNvUriSrcBin:dsnvurisrcbin0/GstDecodeBin:decodebin/nvv4l2decoder:nvv4l2decoder0: enable-max-performance = true
/GstPipeline:pipeline0/GstDsNvUriSrcBin:dsnvurisrcbin0/GstDecodeBin:decodebin/nvv4l2decoder:nvv4l2decoder0: drop-frame-interval = 0
/GstPipeline:pipeline0/GstDsNvUriSrcBin:dsnvurisrcbin0/GstDecodeBin:decodebin/nvv4l2decoder:nvv4l2decoder0: num-extra-surfaces = 1
Opening in BLOCKING MODE 
/GstPipeline:pipeline0/GstDsNvUriSrcBin:dsnvurisrcbin0/GstDecodeBin:decodebin/nvv4l2decoder:nvv4l2decoder0.GstPad:sink: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, level=(string)4, profile=(string)high, pixel-aspect-ratio=(fraction)1/1, width=(int)1920, height=(int)1080, framerate=(fraction)30/1, chroma-format=(string)4:2:0, bit-depth-luma=(uint)8, bit-depth-chroma=(uint)8, parsed=(boolean)true
/GstPipeline:pipeline0/GstDsNvUriSrcBin:dsnvurisrcbin0/GstDecodeBin:decodebin/GstCapsFilter:capsfilter0.GstPad:src: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, level=(string)4, profile=(string)high, pixel-aspect-ratio=(fraction)1/1, width=(int)1920, height=(int)1080, framerate=(fraction)30/1, chroma-format=(string)4:2:0, bit-depth-luma=(uint)8, bit-depth-chroma=(uint)8, parsed=(boolean)true
/GstPipeline:pipeline0/GstDsNvUriSrcBin:dsnvurisrcbin0/GstDecodeBin:decodebin/GstCapsFilter:capsfilter0.GstPad:sink: caps = video/x-h264, stream-format=(string)byte-stream, alignment=(string)au, level=(string)4, profile=(string)high, pixel-aspect-ratio=(fraction)1/1, width=(int)1920, height=(int)1080, framerate=(fraction)30/1, chroma-format=(string)4:2:0, bit-depth-luma=(uint)8, bit-depth-chroma=(uint)8, parsed=(boolean)true
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame

Using rtspsrc : This works without any issues.

gst-launch-1.0 -v \
  rtspsrc location=rtsp://myrtspip:8555/falldown ! \
  decodebin ! \
  nveglglessink

Known Issue Reference

I came across a known issue stating: Jetson_Linux_Release_Notes_r36.3.pdf

이미지 (1)
이미지 (1)2906×838 134 KB

Based on this, I suspect that nvurisrcbin might not be functioning correctly on Jetson platforms, leading to the pipeline getting stuck and dropping frames when using RTSP streams with nvv4l2decoder.

Questions and Requests

  1. nvurisrcbin Functionality on Jetson:
  • Is it expected behavior that nvurisrcbin causes the pipeline to get stuck and drop frames on Jetson Orin AGX when using RTSP streams with nvv4l2decoder?
  • Are there any known workarounds or fixes for this issue?
  1. Compatibility and Patches:
  • Are there any patches or updates in newer versions of DeepStream or JetPack that address this issue?
  • If so, could you provide guidance on how to apply these updates?
  1. Alternative Approaches:
  • Given that rtspsrc works without issues, is there a recommended approach to handle RTSP streams on Jetson Orin AGX with DeepStream to avoid using nvurisrcbin?
3

There is already video decoder inside nvurisrcbin, why do you add video decoder after it?

Please refer to Gst-nvurisrcbin — DeepStream documentation

4

You are right.
But it still doesn’t work when I run the deepstream-test3 code.
The log below occurs when the code is operated.
“Stream format not found, dropping the frame”
And soon after, “segmentation fault” occurs.

5

Can you provide the command line?

6

The command is as follows.

 ./deepstream-test3-app dstest3_config.yml

dstest3_config.yml

source-list:
  #semicolon separated uri. For ex- uri1;uri2;uriN;
  list: rtsp://myip:8554/stream1; #Only here changed

Is there anything else you need?

7

Please add “live-source: 1” setting in the “streammux:” group in the dstest3_config.yml for you are using live source instead of local video file.

8

It is still not running.

export GST_DEBUG=3
./deepstream-test3-app ./dstest3_config.yml


source-list:
  #semicolon separated uri. For ex- uri1;uri2;uriN;
  list: rtsp://192.168.3.11:8554/fire;

streammux:
  batch-size: 1
  batched-push-timeout: 40000
  width: 1920
  height: 1080

Decodebin child added: source
Running...

0:00:05.341571665   222 0xaaaaecbb20c0 WARN                  udpsrc gstudpsrc.c:1637:gst_udpsrc_open:<udpsrc0> warning: Could not create a buffer of requested 524288 bytes (Operation not permitted). Need net.admin privilege?
0:00:05.341653966   222 0xaaaaecbb20c0 WARN                  udpsrc gstudpsrc.c:1647:gst_udpsrc_open:<udpsrc0> have udp buffer of 212992 bytes while 524288 were requested
0:00:05.342227993   222 0xaaaaecbb20c0 WARN                  udpsrc gstudpsrc.c:1637:gst_udpsrc_open:<udpsrc1> warning: Could not create a buffer of requested 524288 bytes (Operation not permitted). Need net.admin privilege?
0:00:05.342282327   222 0xaaaaecbb20c0 WARN                  udpsrc gstudpsrc.c:1647:gst_udpsrc_open:<udpsrc1> have udp buffer of 212992 bytes while 524288 were requested
Decodebin child added: decodebin0
Decodebin child added: rtph264depay0
Decodebin child added: h264parse0
Decodebin child added: capsfilter0
/bin/bash: line 1: lsmod: command not found
/bin/bash: line 1: modprobe: command not found
Decodebin child added: nvv4l2decoder0
Opening in BLOCKING MODE
0:00:06.512346728   222 0xffff08006e40 WARN                    v4l2 gstv4l2object.c:4671:gst_v4l2_object_probe_caps:<nvv4l2decoder0:src> Failed to probe pixel aspect ratio with VIDIOC_CROPCAP: Unknown error -1
NvMMLiteOpen : Block : BlockType = 261
NvMMLiteBlockCreate : Block : BlockType = 261
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
0:00:06.651583625   222 0xffff08006e40 WARN                    v4l2 gstv4l2object.c:4671:gst_v4l2_object_probe_caps:<nvv4l2decoder0:src> Failed to probe pixel aspect ratio with VIDIOC_CROPCAP: Unknown error -1
0:00:06.654510493   222 0xffff08006e40 WARN            v4l2videodec gstv4l2videodec.c:2311:gst_v4l2_video_dec_decide_allocation:<nvv4l2decoder0> Duration invalid, not setting latency
0:00:06.655417116   222 0xffff08006e40 WARN          v4l2bufferpool gstv4l2bufferpool.c:1116:gst_v4l2_buffer_pool_start:<nvv4l2decoder0:pool:src> Uncertain or not enough buffers, enabling copy threshold
0:00:06.675240318   222 0xfffef8011cc0 WARN          v4l2bufferpool gstv4l2bufferpool.c:1567:gst_v4l2_buffer_pool_dqbuf:<nvv4l2decoder0:pool:src> Driver should never set v4l2_buffer.field to ANY
0:00:06.677712995   222 0xfffef8011cc0 WARN            v4l2videodec gstv4l2videodec.c:1328:gst_v4l2_video_dec_loop:<nvv4l2decoder0> Decoder is producing too many buffers
0:00:06.680081291   222 0xfffef8011cc0 WARN            v4l2videodec gstv4l2videodec.c:1328:gst_v4l2_video_dec_loop:<nvv4l2decoder0> Decoder is producing too many buffers
0:00:06.684961719   222 0xfffef8011cc0 WARN            v4l2videodec gstv4l2videodec.c:1328:gst_v4l2_video_dec_loop:<nvv4l2decoder0> Decoder is producing too many buffers
0:00:06.687621364   222 0xfffef8011cc0 WARN            v4l2videodec gstv4l2videodec.c:1328:gst_v4l2_video_dec_loop:<nvv4l2decoder0> Decoder is producing too many buffers
Frame Number = 0 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Segmentation fault (core dumped)

I wrote my personal code using “nvmultiurisrcbin”.
So I hope the code for test3 and test5 works, but it doesn’t.

"<nvv4l2decoder0:src> Failed to probe pixel aspect ratio with VIDIOC_CROPCAP: Unknown error -1"

If I see the above error and I can’t use it, it’s a very big problem for me.

9

That means theere some non standard video payload inside the RTSP stream. What is the RTSP source you are using? IP camera?

10

Where is the “live-source: 1”?

11

I’m sorry.
I added it to the code, but it doesn’t seem to apply.

source-list:
  #semicolon separated uri. For ex- uri1;uri2;uriN;
  list: rtsp://192.168.3.11:8554/fire;

streammux:
  live-source: 1
  batch-size: 1
  batched-push-timeout: 40000
  width: 1920
  height: 1080


Decodebin child added: decodebin0
Decodebin child added: rtph264depay0
Decodebin child added: h264parse0
Decodebin child added: capsfilter0
/bin/bash: line 1: lsmod: command not found
/bin/bash: line 1: modprobe: command not found
Decodebin child added: nvv4l2decoder0
Opening in BLOCKING MODE
0:00:06.302747739   381 0xffff18006640 WARN                    v4l2 gstv4l2object.c:4671:gst_v4l2_object_probe_caps:<nvv4l2decoder0:src> Failed to probe pixel aspect ratio with VIDIOC_CROPCAP: Unknown error -1
NvMMLiteOpen : Block : BlockType = 261
NvMMLiteBlockCreate : Block : BlockType = 261
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
0:00:06.437270547   381 0xffff18006640 WARN                    v4l2 gstv4l2object.c:4671:gst_v4l2_object_probe_caps:<nvv4l2decoder0:src> Failed to probe pixel aspect ratio with VIDIOC_CROPCAP: Unknown error -1
0:00:06.440474802   381 0xffff18006640 WARN            v4l2videodec gstv4l2videodec.c:2311:gst_v4l2_video_dec_decide_allocation:<nvv4l2decoder0> Duration invalid, not setting latency
0:00:06.441602588   381 0xffff18006640 WARN          v4l2bufferpool gstv4l2bufferpool.c:1116:gst_v4l2_buffer_pool_start:<nvv4l2decoder0:pool:src> Uncertain or not enough buffers, enabling copy threshold
0:00:06.468735196   381 0xffff140114c0 WARN          v4l2bufferpool gstv4l2bufferpool.c:1567:gst_v4l2_buffer_pool_dqbuf:<nvv4l2decoder0:pool:src> Driver should never set v4l2_buffer.field to ANY
0:00:06.471197067   381 0xffff140114c0 WARN            v4l2videodec gstv4l2videodec.c:1328:gst_v4l2_video_dec_loop:<nvv4l2decoder0> Decoder is producing too many buffers
0:00:06.473544796   381 0xffff140114c0 WARN            v4l2videodec gstv4l2videodec.c:1328:gst_v4l2_video_dec_loop:<nvv4l2decoder0> Decoder is producing too many buffers
0:00:06.476030826   381 0xffff140114c0 WARN            v4l2videodec gstv4l2videodec.c:1328:gst_v4l2_video_dec_loop:<nvv4l2decoder0> Decoder is producing too many buffers
0:00:06.480836778   381 0xffff140114c0 WARN            v4l2videodec gstv4l2videodec.c:1328:gst_v4l2_video_dec_loop:<nvv4l2decoder0> Decoder is producing too many buffers
Frame Number = 0 Number of objects = 0 Vehicle Count = 0 Person Count = 0

Video plays well when you output rtsp on ffplay.
Attached is a picture.

Screenshot from 2024-12-12 15-42-26
Screenshot from 2024-12-12 15-42-261920×1080 174 KB

13

What is the RTSP source you are using? IP camera?

14

rtsp is turning video into ffmpeg and turning it over to rtsp.

ffmpeg -re -stream_loop -1  -i ./fire.mp4 -c copy -f rtsp rtsp://localhost:8554/fire

and using mediamtx

docker run --rm -it \
-e MTX_PROTOCOLS=tcp \
-e MTX_WEBRTCADDITIONALHOSTS=192.168.x.x \
-p 8554:8554 \
bluenviron/mediamtx
15

Just in case, I also share the docker-compose file.

 deepstream:
    build:
      context: .
      dockerfile: ./Dockerfile
    stdin_open: true
    tty: true
    runtime: nvidia
    restart: unless-stopped
    volumes:
      - /tmp/.X11-unix:/tmp/.X11-unix
      - ./piadeepstream:/home
    environment:
      - DISPLAY=:0
      - NVIDIA_VISIBLE_DEVICES=all
      - NVIDIA_DRIVER_CAPABILITIES=compute,utility
    networks:
      - deepstream-mq


FROM nvcr.io/nvidia/deepstream:6.4-triton-multiarch

RUN apt update -y

RUN sh /opt/nvidia/deepstream/deepstream/user_additional_install.sh

RUN apt-get install libgstreamer-plugins-base1.0-dev libgstreamer1.0-dev libopencv-dev libcurl4-openssl-dev  -y

RUN apt-get install -y locales

RUN apt-get install -y language-pack-ko

RUN locale-gen ko_KR.utf8

RUN dpkg-reconfigure locales

RUN mkdir /home/App

COPY ./piadeepstream/ /home/

WORKDIR /home/App
16

That means the video payload in the RTSP stream is not recognizable. Can you put the complete log here?

I notice there is segment fault in your previous log, can you provide the crash stack?

17

Here you are.
If you need anything else, i can provide you with more.

root@01e12aa05342:/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-test3# ./deepstream-test3-app dstest3_config.yml
Now playing : rtsp://192.168.3.11:8554/fire
Using file: dstest3_config.yml
0:00:04.803932275   428 0xaaaad28e1990 INFO                 nvinfer gstnvinfer.cpp:682:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::deserializeEngineAndBackend() <nvdsinfer_context_impl.cpp:2092> [UID = 1]: deserialized trt engine from :/opt/nvidia/deepstream/deepstream-6.4/samples/models/Primary_Detector/resnet18_trafficcamnet.etlt_b1_gpu0_int8.engine
INFO: [Implicit Engine Info]: layers num: 3
0   INPUT  kFLOAT input_1         3x544x960
1   OUTPUT kFLOAT output_bbox/BiasAdd 16x34x60
2   OUTPUT kFLOAT output_cov/Sigmoid 4x34x60

0:00:05.130209457   428 0xaaaad28e1990 INFO                 nvinfer gstnvinfer.cpp:682:gst_nvinfer_logger:<primary-nvinference-engine> NvDsInferContext[UID 1]: Info from NvDsInferContextImpl::generateBackendContext() <nvdsinfer_context_impl.cpp:2195> [UID = 1]: Use deserialized engine model: /opt/nvidia/deepstream/deepstream-6.4/samples/models/Primary_Detector/resnet18_trafficcamnet.etlt_b1_gpu0_int8.engine
0:00:05.140940269   428 0xaaaad28e1990 INFO                 nvinfer gstnvinfer_impl.cpp:328:notifyLoadModelStatus:<primary-nvinference-engine> [UID 1]: Load new model:/opt/nvidia/deepstream/deepstream-6.4/sources/apps/sample_apps/deepstream-test3/dstest3_pgie_config.yml sucessfully
Decodebin child added: source
Running...
0:00:05.171178808   428 0xaaaad21f58c0 WARN                  udpsrc gstudpsrc.c:1637:gst_udpsrc_open:<udpsrc0> warning: Could not create a buffer of requested 524288 bytes (Operation not permitted). Need net.admin privilege?
0:00:05.171253078   428 0xaaaad21f58c0 WARN                  udpsrc gstudpsrc.c:1647:gst_udpsrc_open:<udpsrc0> have udp buffer of 212992 bytes while 524288 were requested

Decodebin child added: decodebin0
Decodebin child added: rtph264depay0
Decodebin child added: h264parse0
Decodebin child added: capsfilter0
/bin/bash: line 1: lsmod: command not found
/bin/bash: line 1: modprobe: command not found
Decodebin child added: nvv4l2decoder0
Opening in BLOCKING MODE
0:00:06.344301940   428 0xfffefc006e40 WARN                    v4l2 gstv4l2object.c:4671:gst_v4l2_object_probe_caps:<nvv4l2decoder0:src> Failed to probe pixel aspect ratio with VIDIOC_CROPCAP: Unknown error -1
NvMMLiteOpen : Block : BlockType = 261
NvMMLiteBlockCreate : Block : BlockType = 261
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
Stream format not found, dropping the frame
0:00:06.780980732   428 0xfffefc006e40 WARN                    v4l2 gstv4l2object.c:4671:gst_v4l2_object_probe_caps:<nvv4l2decoder0:src> Failed to probe pixel aspect ratio with VIDIOC_CROPCAP: Unknown error -1
0:00:06.784426302   428 0xfffefc006e40 WARN            v4l2videodec gstv4l2videodec.c:2311:gst_v4l2_video_dec_decide_allocation:<nvv4l2decoder0> Duration invalid, not setting latency
0:00:06.785771322   428 0xfffefc006e40 WARN          v4l2bufferpool gstv4l2bufferpool.c:1116:gst_v4l2_buffer_pool_start:<nvv4l2decoder0:pool:src> Uncertain or not enough buffers, enabling copy threshold
0:00:06.802952071   428 0xfffef80114c0 WARN          v4l2bufferpool gstv4l2bufferpool.c:1567:gst_v4l2_buffer_pool_dqbuf:<nvv4l2decoder0:pool:src> Driver should never set v4l2_buffer.field to ANY
0:00:06.805379365   428 0xfffef80114c0 WARN            v4l2videodec gstv4l2videodec.c:1328:gst_v4l2_video_dec_loop:<nvv4l2decoder0> Decoder is producing too many buffers
Frame Number = 0 Number of objects = 0 Vehicle Count = 0 Person Count = 0
Segmentation fault (core dumped)
root@01e12aa05342:/opt/nvidia/deepstream/deepstream/sources/apps/sample_apps/deepstream-test3#
18

I notice there is segment fault in your previous log, can you provide the crash stack?

19

Is this what you want?

fer.field to ANY
0:00:07.910448912   531 0xfffef40114c0 WARN            v4l2videodec gstv4l2videodec.c:1328:gst_v4l2_video_dec_loop:<nvv4l2decoder0> Decoder is producing too many buffers
0:00:07.912826065   531 0xfffef40114c0 WARN            v4l2videodec gstv4l2videodec.c:1328:gst_v4l2_video_dec_loop:<nvv4l2decoder0> Decoder is producing too many buffers
0:00:07.915313967   531 0xfffef40114c0 WARN            v4l2videodec gstv4l2videodec.c:1328:gst_v4l2_video_dec_loop:<nvv4l2decoder0> Decoder is producing too many buffers
0:00:07.917772206   531 0xfffef40114c0 WARN            v4l2videodec gstv4l2videodec.c:1328:gst_v4l2_video_dec_loop:<nvv4l2decoder0> Decoder is producing too many buffers
0:00:07.920290059   531 0xfffef40114c0 WARN            v4l2videodec gstv4l2videodec.c:1328:gst_v4l2_video_dec_loop:<nvv4l2decoder0> Decoder is producing too many buffers
[New Thread 0xfffee8d9c840 (LWP 582)]
Frame Number = 0 Number of objects = 3 Vehicle Count = 3 Person Count = 0
Frame Number = 1 Number of objects = 2 Vehicle Count = 2 Person Count = 0
Frame Number = 2 Number of objects = 3 Vehicle Count = 3 Person Count = 0
Frame Number = 3 Number of objects = 2 Vehicle Count = 2 Person Count = 0
Thread 9 "queue2:src" received signal SIGSEGV, Segmentation fault.
[Switching to Thread 0xffff314c2840 (LWP 546)]
0x0000ffff88c2779c in NvBufSurfTransformAsync () from /usr/lib/aarch64-linux-gnu/nvidia/libnvbufsurftransform.so.1.0.0
(gdb) bt
#0  0x0000ffff88c2779c in NvBufSurfTransformAsync () at /usr/lib/aarch64-linux-gnu/nvidia/libnvbufsurftransform.so.1.0.0
#1  0x0000ffff815b0aac [PAC] in  () at /usr/lib/aarch64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_multistreamtiler.so
#2  0x0000ffff815b22e4 [PAC] in  () at /usr/lib/aarch64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_multistreamtiler.so
#3  0x0000ffff815ae40c [PAC] in  () at /usr/lib/aarch64-linux-gnu/gstreamer-1.0/deepstream/libnvdsgst_multistreamtiler.so
#4  0x0000ffff9331b8b4 [PAC] in  () at /lib/aarch64-linux-gnu/libgstbase-1.0.so.0
#5  0x0000ffff9331ac5c in  () at /lib/aarch64-linux-gnu/libgstbase-1.0.so.0
#6  0x0000ffff93fa4978 in  () at /lib/aarch64-linux-gnu/libgstreamer-1.0.so.0
#7  0x0000ffff93fa7bb8 in  () at /lib/aarch64-linux-gnu/libgstreamer-1.0.so.0
#8  0x0000ffff93fa7fe8 in gst_pad_push () at /lib/aarch64-linux-gnu/libgstreamer-1.0.so.0
#9  0x0000ffff9331ad6c in  () at /lib/aarch64-linux-gnu/libgstbase-1.0.so.0
#10 0x0000ffff93fa4978 in  () at /lib/aarch64-linux-gnu/libgstreamer-1.0.so.0
#11 0x0000ffff93fa7bb8 in  () at /lib/aarch64-linux-gnu/libgstreamer-1.0.so.0
#12 0x0000ffff93fa7fe8 in gst_pad_push () at /lib/aarch64-linux-gnu/libgstreamer-1.0.so.0
#13 0x0000ffff816d36fc in  () at /usr/lib/aarch64-linux-gnu/gstreamer-1.0/libgstcoreelements.so
#14 0x0000ffff93fd070c in  () at /lib/aarch64-linux-gnu/libgstreamer-1.0.so.0
#15 0x0000ffff93dc7658 in  () at /lib/aarch64-linux-gnu/libglib-2.0.so.0
#16 0x0000ffff93dc4980 in  () at /lib/aarch64-linux-gnu/libglib-2.0.so.0
#17 0x0000ffff939ed5c8 in  () at /lib/aarch64-linux-gnu/libc.so.6
#18 0x0000ffff93a55d9c in  () at /lib/aarch64-linux-gnu/libc.so.6
20

I can’t reproduce the error with our test video. Can you provide the fire.mp4 file?

21

Here you are.

If I install the bsp incorrectly, could the problem occur?

I’m using Avermedia’s board, and I think it might be a firmware issue.

22

I tried your video. Neither “Stream format not found, dropping the frame” nor the segment fault happens with the video streaming from ffmpeg+mediamtx in my board.