How to get ntp_timestamp behind nvmultistreamtiler element

[duanchengwen07]

Please provide complete information as applicable to your setup.

• Hardware Platform (Jetson / GPU) jetson
• DeepStream Version 6.1
• JetPack Version (valid for Jetson only) 5.0.2
• TensorRT Version 8.4.1.5
• NVIDIA GPU Driver Version (valid for GPU only)
• Issue Type( questions, new requirements, bugs)
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)
• Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)

tiler = gst_element_factory_make ("nvmultistreamtiler", "nvtiler");  
gst_element_link_many (streammux, queue1, pgie, queue2, nvdslogger, tiler, queue3, nvvidconv, queue4, nvosd, queue5, sink, NULL)

GstPad *pgie_src_pad =gst_element_get_static_pad(pgie, "src"); 
gst_pad_add_probe (pgie_src_pad, GST_PAD_PROBE_TYPE_BUFFER, pgie_pad_buffer_probe, NULL, NULL);

for example, when i put pgie before tiler element, i can get ntp_timestamp in pgie_pad_buffer_probe method, but when i change gst_element_link_many like this

gst_element_link_many (streammux, queue1, nvdslogger, tiler, queue2, pgie, queue3, nvvidconv, queue4, nvosd, queue5, sink, NULL)

i can’t get ntp_timestamp in pgie_pad_buffer_probe method.
how can i get ntp_timestamp after tiler element

[yuweiw]

Why do you put the tiler before pgie? The Gst-nvmultistreamtiler plugin composites a 2D tile from batched buffers. It will change some meta information.

[duanchengwen07]

I am running the bev model, i need to stitch the pictures of 6 cameras into on picture and then infer

[yuweiw]

OK. Currently, after nvmultistreamtiler composites a 2D tile from batched buffers, ntp_timestamp has not been reassigned. Because it doesn’t know which frame’s pts in the batched buffers to take as ntp_timestamp. You can add the ntp_timestamp after the nvmultistreamtiler in the src_probe of it by yourself.

[duanchengwen07]

how can i get the batched buffers’s ntp_timestamp in the src_probe of nvmultistreamtiler？ has any sample code ?

[yuweiw]

There is no update from you for a period, assuming this is not an issue anymore. Hence we are closing this topic. If need further support, please open a new one. Thanks

What I mean is that you need to assign the ntp_timestamp according to the video frame rate by yourself in the src_probe of nvmultistreamtiler.