Error in Deepstream pipeline on AGX Orin

Accelerated Computing Intelligent Video Analytics DeepStream SDK
1

Hi, I was trying to run multiple decode pipeline in parallel on AGX Orin platform.

Jetpack version
6.0
Deepstream version
7.0
Video source
H265 1080p 30FPS
Pipeline
gst-launch-1.0 -v filesrc location=sample.h265 ! h265parse ! nvv4l2decoder ! fpsdisplaysink text-overlay=false video-sink=fakesink sync=true --verbose 2>&1 | tee log0.txt &
gst-launch-1.0 -v filesrc location=sample.h265 ! h265parse ! nvv4l2decoder ! fpsdisplaysink text-overlay=false video-sink=fakesink sync=true --verbose 2>&1 | tee log1.txt &
gst-launch-1.0 -v filesrc location=sample.h265 ! h265parse ! nvv4l2decoder ! fpsdisplaysink text-overlay=false video-sink=fakesink sync=true --verbose 2>&1 | tee log2.txt &
gst-launch-1.0 -v filesrc location=sample.h265 ! h265parse ! nvv4l2decoder ! fpsdisplaysink text-overlay=false video-sink=fakesink sync=true --verbose 2>&1 | tee log3.txt &
gst-launch-1.0 -v filesrc location=sample.h265 ! h265parse ! nvv4l2decoder ! fpsdisplaysink text-overlay=false video-sink=fakesink sync=true --verbose 2>&1 | tee log4.txt &
gst-launch-1.0 -v filesrc location=sample.h265 ! h265parse ! nvv4l2decoder ! fpsdisplaysink text-overlay=false video-sink=fakesink sync=true --verbose 2>&1 | tee log5.txt &
gst-launch-1.0 -v filesrc location=sample.h265 ! h265parse ! nvv4l2decoder ! fpsdisplaysink text-overlay=false video-sink=fakesink sync=true --verbose 2>&1 | tee log6.txt &
gst-launch-1.0 -v filesrc location=sample.h265 ! h265parse ! nvv4l2decoder ! fpsdisplaysink text-overlay=false video-sink=fakesink sync=true --verbose 2>&1 | tee log7.txt &
gst-launch-1.0 -v filesrc location=sample.h265 ! h265parse ! nvv4l2decoder ! fpsdisplaysink text-overlay=false video-sink=fakesink sync=true --verbose 2>&1 | tee log8.txt &
gst-launch-1.0 -v filesrc location=sample.h265 ! h265parse ! nvv4l2decoder ! fpsdisplaysink text-overlay=false video-sink=fakesink sync=true --verbose 2>&1 | tee log9.txt

Some pipeline will automatically terminated with error message “ERROR: from element /GstPipeline:pipeline0/nvv4l2decoder:nvv4l2decoder0: Failed to process frame.
Additional debug info:
/dvs/git/dirty/git-master_linux/3rdparty/gst/gst-v4l2/gst-v4l2/gstv4l2videodec.c(2279): gst_v4l2_video_dec_handle_frame (): /GstPipeline:pipeline0/nvv4l2decoder:nvv4l2decoder0:
Maybe be due to not enough memory or failing driver”
There is still memory buffer left (RAM 6767/30697MB) when verified using tegrastats.

Does anyone face with this issue and know how to resolve it?
Detail error message is included inside log.txt.
log.txt (2.7 KB)

3

Can you provide the “sample.h265” file?

4

Sorry that I couldn’t provide sample.h265. But you may try with other open source H265 video.

5

Can you tell me the information about your “sample.h265” file? The resolution, FPS, profile/level,…

6

Here is the information of sample.h265 that is obtained using mediainfo

Format : HEVC
Format/Info : High Efficiency Video Coding
File size : 33.9 MiB
Writing library : x265 3.5+37-07b011400:[Windows][GCC 11.2.0][64 bit] 8bit+10bit+12bit
Encoding settings : cpuid=1111039 / frame-threads=3 / numa-pools=8 / wpp / no-pmode / no-pme / no-psnr / no-ssim / log-level=2 / input-csp=1 / input-res=1920x1080 / interlace=0 / total-frames=0 / level-idc=0 / high-tier=1 / uhd-bd=0 / ref=3 / no-allow-non-conformance / repeat-headers / annexb / no-aud / no-eob / no-eos / no-hrd / info / hash=0 / no-temporal-layers / open-gop / min-keyint=25 / keyint=250 / gop-lookahead=0 / bframes=0 / b-adapt=2 / no-b-pyramid / bframe-bias=0 / rc-lookahead=20 / lookahead-slices=6 / scenecut=40 / no-hist-scenecut / radl=0 / no-splice / no-intra-refresh / ctu=64 / min-cu-size=8 / no-rect / no-amp / max-tu-size=32 / tu-inter-depth=1 / tu-intra-depth=1 / limit-tu=0 / rdoq-level=0 / dynamic-rd=0.00 / no-ssim-rd / signhide / no-tskip / nr-intra=0 / nr-inter=0 / no-constrained-intra / strong-intra-smoothing / max-merge=3 / limit-refs=1 / no-limit-modes / me=1 / subme=2 / merange=57 / temporal-mvp / no-frame-dup / no-hme / weightp / no-weightb / no-analyze-src-pics / deblock=0:0 / sao / no-sao-non-deblock / rd=3 / selective-sao=4 / early-skip / rskip / no-fast-intra / no-tskip-fast / no-cu-lossless / b-intra / no-splitrd-skip / rdpenalty=0 / psy-rd=2.00 / psy-rdoq=0.00 / no-rd-refine / no-lossless / cbqpoffs=0 / crqpoffs=0 / rc=abr / bitrate=4000 / qcomp=0.60 / qpstep=4 / stats-write=0 / stats-read=0 / ipratio=1.40 / aq-mode=2 / aq-strength=1.00 / cutree / zone-count=0 / no-strict-cbr / qg-size=32 / no-rc-grain / qpmax=69 / qpmin=0 / no-const-vbv / sar=1 / overscan=0 / videoformat=5 / range=1 / colorprim=2 / transfer=2 / colormatrix=5 / chromaloc=1 / chromaloc-top=1 / chromaloc-bottom=1 / display-window=0 / cll=0,0 / min-luma=0 / max-luma=255 / log2-max-poc-lsb=8 / vui-timing-info / vui-hrd-info / slices=1 / no-opt-qp-pps / no-opt-ref-list-length-pps / no-multi-pass-opt-rps / scenecut-bias=0.05 / hist-threshold=0.03 / no-opt-cu-delta-qp / no-aq-motion / no-hdr10 / no-hdr10-opt / no-dhdr10-opt / no-idr-recovery-sei / analysis-reuse-level=0 / analysis-save-reuse-level=0 / analysis-load-reuse-level=0 / scale-factor=0 / refine-intra=0 / refine-inter=0 / refine-mv=1 / refine-ctu-distortion=0 / no-limit-sao / ctu-info=0 / no-lowpass-dct / refine-analysis-type=0 / copy-pic=1 / max-ausize-factor=1.0 / no-dynamic-refine / no-single-sei / no-hevc-aq / no-svt / no-field / qp-adaptation-range=1.00 / scenecut-aware-qp=0conformance-window-offsets / right=0 / bottom=0 / decoder-max-rate=0 / no-vbv-live-multi-pass

Video
Format : HEVC
Format/Info : High Efficiency Video Coding
Format profile : Main@L4@Main
Width : 1 920 pixels
Height : 1 080 pixels
Display aspect ratio : 16:9
Frame rate : 30.000 FPS
Color space : YUV
Chroma subsampling : 4:2:0 (Type 1)
Bit depth : 8 bits
Writing library : x265 3.5+37-07b011400:[Windows][GCC 11.2.0][64 bit] 8bit+10bit+12bit
Encoding settings : cpuid=1111039 / frame-threads=3 / numa-pools=8 / wpp / no-pmode / no-pme / no-psnr / no-ssim / log-level=2 / input-csp=1 / input-res=1920x1080 / interlace=0 / total-frames=0 / level-idc=0 / high-tier=1 / uhd-bd=0 / ref=3 / no-allow-non-conformance / repeat-headers / annexb / no-aud / no-eob / no-eos / no-hrd / info / hash=0 / no-temporal-layers / open-gop / min-keyint=25 / keyint=250 / gop-lookahead=0 / bframes=0 / b-adapt=2 / no-b-pyramid / bframe-bias=0 / rc-lookahead=20 / lookahead-slices=6 / scenecut=40 / no-hist-scenecut / radl=0 / no-splice / no-intra-refresh / ctu=64 / min-cu-size=8 / no-rect / no-amp / max-tu-size=32 / tu-inter-depth=1 / tu-intra-depth=1 / limit-tu=0 / rdoq-level=0 / dynamic-rd=0.00 / no-ssim-rd / signhide / no-tskip / nr-intra=0 / nr-inter=0 / no-constrained-intra / strong-intra-smoothing / max-merge=3 / limit-refs=1 / no-limit-modes / me=1 / subme=2 / merange=57 / temporal-mvp / no-frame-dup / no-hme / weightp / no-weightb / no-analyze-src-pics / deblock=0:0 / sao / no-sao-non-deblock / rd=3 / selective-sao=4 / early-skip / rskip / no-fast-intra / no-tskip-fast / no-cu-lossless / b-intra / no-splitrd-skip / rdpenalty=0 / psy-rd=2.00 / psy-rdoq=0.00 / no-rd-refine / no-lossless / cbqpoffs=0 / crqpoffs=0 / rc=abr / bitrate=4000 / qcomp=0.60 / qpstep=4 / stats-write=0 / stats-read=0 / ipratio=1.40 / aq-mode=2 / aq-strength=1.00 / cutree / zone-count=0 / no-strict-cbr / qg-size=32 / no-rc-grain / qpmax=69 / qpmin=0 / no-const-vbv / sar=1 / overscan=0 / videoformat=5 / range=1 / colorprim=2 / transfer=2 / colormatrix=5 / chromaloc=1 / chromaloc-top=1 / chromaloc-bottom=1 / display-window=0 / cll=0,0 / min-luma=0 / max-luma=255 / log2-max-poc-lsb=8 / vui-timing-info / vui-hrd-info / slices=1 / no-opt-qp-pps / no-opt-ref-list-length-pps / no-multi-pass-opt-rps / scenecut-bias=0.05 / hist-threshold=0.03 / no-opt-cu-delta-qp / no-aq-motion / no-hdr10 / no-hdr10-opt / no-dhdr10-opt / no-idr-recovery-sei / analysis-reuse-level=0 / analysis-save-reuse-level=0 / analysis-load-reuse-level=0 / scale-factor=0 / refine-intra=0 / refine-inter=0 / refine-mv=1 / refine-ctu-distortion=0 / no-limit-sao / ctu-info=0 / no-lowpass-dct / refine-analysis-type=0 / copy-pic=1 / max-ausize-factor=1.0 / no-dynamic-refine / no-single-sei / no-hevc-aq / no-svt / no-field / qp-adaptation-range=1.00 / scenecut-aware-qp=0conformance-window-offsets / right=0 / bottom=0 / decoder-max-rate=0 / no-vbv-live-multi-pass
Color range : Full
Matrix coefficients : BT.470 System B/G

7

What is your AGX Orin’s type? AGX Orin 64GB, Jetson AGX Orin Industrial or Jetson AGX Orin 32GB?

The log shows that the video decoder reaches to its limitation.
According to Jetson Modules, Support, Ecosystem, and Lineup | NVIDIA Developer, at least 15 1080p@30fps H265 streams can be supported with AGX Orin, please check whether the other processes in your device are using the hardware video decoder.

8

AGX Orin 64GB.
I was expecting the FPS value will drop when increasing more stream instead of being terminated. Is it the expected behavior that additional stream will be terminated?

9

No. The termination is caused by lacking of hardware resources but not for the speed.

Yes.

10

There is no update from you for a period, assuming this is not an issue anymore. Hence we are closing this topic. If need further support, please open a new one. Thanks

11

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.