Does deepstream gst-nvstreamux uses ntp timestamp for multiple input streams synchronization?

[ehsan.babaee]

In deepstream gst-nvstreammux the sync-inputs property inside the property table is defined as “Boolean property to sychronization of input frames using PTS”.

https://docs.nvidia.com/metropolis/deepstream/dev-guide/text/DS_plugin_gst-nvstreammux.html

and in the new streammux documentation, it defines it as "Synchronize Inputs. Boolean property to force timestamp sychronization of input frames.".

https://docs.nvidia.com/metropolis/deepstream/dev-guide/text/DS_plugin_gst-nvstreammux2.html

does the new gst-nvstreammux uses the RTCP NTP timestamp for synchronizing the frames from multiple RTSP streams or the PTS time?

[fanzh]

Please provide complete information as applicable to your setup.
• Hardware Platform (Jetson / GPU)
• DeepStream Version
• JetPack Version (valid for Jetson only)
• TensorRT Version
• NVIDIA GPU Driver Version (valid for GPU only)
• Issue Type( questions, new requirements, bugs)
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)
• Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)

[ehsan.babaee]

Thank you for your answer, it is not actually an issue, just a question.

I want to know how sync-inputs property actually works, does it use RTCP ntp timestamp for synchronization or the PTS timestamp?

We are using deepstream 7, on Jetson Orin, or dGPU.

• Hardware Platform (Jetson / GPU) Jetson Orin-nano
• DeepStream Version DS v7.1
• JetPack Version (valid for Jetson only)
• TensorRT Version 8.6.2.3-1+cuda12.2
• Issue Type( questions, new requirements, bugs) questions

[fanzh]

@ehsan.babaee

I want to know how sync-inputs property actually works, does it use RTCP ntp timestamp for synchronization or the PTS timestamp?

No, RTCP ntp timestamp is added into meta for custom use. you can get ntp_timestamp in frame meta.
please refer to the doc above. you will get some explanations after finding “sync-inputs”.
new sterammux plugin and low-level are opensource. please refer to synchronize_buffers_in_pad. the “sync-inputs” mechanism will remove and skip late buffer.