Smart Record "refused renegotiation to video/x-h264"

Please provide complete information as applicable to your setup.

• Hardware Platform (Jetson / GPU)
Jetson Xavier NX Developer Kit
• DeepStream Version
• JetPack Version (valid for Jetson only)
4.5.2 [L4T 32.5.1]
• TensorRT Version
• NVIDIA GPU Driver Version (valid for GPU only)
• Issue Type( questions, new requirements, bugs)

We are running a Deepstream app, and triggering smart record from within Deepstream via a probe function when certain objects are detected within the frame.

Smart Record is working without issue when we stream on 1920x1080p RTSP streams, with the following characteristics (taken from ffprobe):

  • Stream #0:0: Video: hevc (Main), yuvj420p(pc, bt709), 1920x1080 [SAR 1:1 DAR 16:9], 5 fps, 50 tbr, 90k tbn, 5 tbc

However, when we run the Deepstream application with the following stream:
Stream #0:0: Video: h264 (Main), yuvj420p(pc, bt709, progressive), 2304x1296 [SAR 1:1 DAR 16:9], 6 fps, 50 tbr, 90k tbn, 12 tbc

We see the following error:

2021-12-21T09:55:52.171Z  **PERF:  4.97 (5.00)     4.95 (5.00)     5.35 (6.62).  2021-12-21T09:55:56.348Z  WARNING from mux_elem2: Can't change input format at runtime..  2021-12-21T09:55:56.349Z  Debug info: gstqtmux.c(5757): gst_qt_mux_video_sink_set_caps (): /GstPipeline:pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin2/GstBin:record_bin2/GstBin:enc_bin2/GstQTMux:mux_elem2:.  2021-12-21T09:55:56.349Z  pad video_0 refused renegotiation to video/x-h264, stream-format=(string)avc, alignment=(string)au, codec_data=(buffer)014d0032ffe1002f674d00329a650120051ff80b7010101400000fa000023283a1800ec40003b0daef2e343001d88000761b5de5c2800001000568ee3c8000, level=(string)5, profile=(string)main, pixel-aspect-ratio=(fraction)1/1, width=(int)2304, height=(int)1296, framerate=(fraction)18/1, interlace-mode=(string)progressive, chroma-format=(string)4:2:0, bit-depth-luma=(uint)8, bit-depth-chroma=(uint)8, parsed=(boolean)true.  2021-12-21T09:55:56.355Z  WARNING from mux_elem2: Can't change input format at runtime..  2021-12-21T09:55:56.356Z  Debug info: gstqtmux.c(5757): gst_qt_mux_video_sink_set_caps (): /GstPipeline:pipeline/GstBin:multi_src_bin/GstBin:src_sub_bin2/GstBin:record_bin2/GstBin:enc_bin2/GstQTMux:mux_elem2:.  2021-12-21T09:55:56.357Z  pad video_0 refused renegotiation to video/x-h264, stream-format=(string)avc, alignment=(string)au, codec_data=(buffer)014d0032ffe1002f674d00329a650120051ff80b7010101400000fa000023283a1800ec40003b0daef2e343001d88000761b5de5c2800001000568ee3c8000, level=(string)5, profile=(string)main, pixel-aspect-ratio=(fraction)1/1, width=(int)2304, height=(int)1296, framerate=(fraction)18/1, interlace-mode=(string)progressive, chroma-format=(string)4:2:0, bit-depth-luma=(uint)8, bit-depth-chroma=(uint)8, parsed=(boolean)true.  2021-12-21T09:55:56.777Z  NvMMLiteOpen : Block : BlockType = 261.  2021-12-21T09:55:56.778Z  NVMEDIA: Reading vendor.tegra.display-size : status: 6.  2021-12-21T09:55:56.781Z  NvMMLiteBlockCreate : Block : BlockType = 261.  2021-12-21T09:55:56.786Z  Opening in BLOCKING MODE.  2021-12-21T09:55:56.786Z  Opening in BLOCKING MODE.  2021-12-21T09:55:57.170Z  **PERF:  5.04 (5.00)     5.05 (5.00)     11.59 (6.71).  2021-12-21T09:56:02.170Z  **PERF:  5.01 (5.00)     4.97 (5.00)     18.46 (6.92).  2021-12-21T09:56:03.457Z  NvMMLiteOpen : Block : BlockType = 261.  2021-12-21T09:56:03.458Z  NVMEDIA: Reading vendor.tegra.display-size : status: 6.  2021-12-21T09:56:03.463Z  Opening in BLOCKING MODE.  2021-12-21T09:56:03.463Z  Opening in BLOCKING MODE.  2021-12-21T09:56:03.468Z  NvMMLiteBlockCreate : Block : BlockType = 261.  2021-12-21T09:56:07.172Z  **PERF:  4.99 (5.00)     5.04 (5.00)     8.03 (6.93). 

Stream-mux is configured as follows:

[streammux]
gpu-id = 0
live-source = 1
batch-size = 1
batched-push-timeout = 40000
width = 1920
height = 1080
enable-padding = 0
nvbuf-memory-type = 0

Are there any resolution restrictions on smart-record?

• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)

• Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)

NA

Smart record works with compressed video, resolution do not impact anything.

It is qtmux refused negotiation but not nvstreammux. qtmux
You can try with “gst-launch” command line to check whether the ES in your RTSP stream can be supported by qtmux. It is a pure gstreamer issue, it has nothing to do with deepstream.

Thanks for the prompt reply. Could you suggest a command using qtmux that would diagnose the issue?

Please google for the qtmux pipeline

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.