Please provide complete information as applicable to your setup. • Tesla T4 • DeepStream 6.1 • TensorRT 22.214.171.124
**• NVIDIA GPU Driver Version 510.47.03 ** • Insert probes to measure delay
I have been testing Deepstream 6.1 using source1_usb_dec_infer_resnet_int8.txt. As far as I know, it creates 5 components:
There are 5 components:
I would like to put probes in specific positions to calculate the latency. I know that the components below are not open-source (correct me if I am wrong) :
So I was wondering if anyone could advise if there is any way to calculate the latency for the components above by putting probes in other places. Perhaps, in between pipeline components there are calling function or something.
You can insert a probe on sink pad of the decoder, measure the time at which input buffer arrives. Insert another probe on sink pad of the sink component and measure the time at which output buffer arrives corresponding to the input buffer . Time difference between these two will give you the latency of the buffer."
Could you help me to allocate those sink pads?
I would appreciate any help.
PS. I know that I can get latency info using NvDs Latency Measurement API. But for the sake of a project, I have to put my own probes.
after creating bin, find the specific element of bin, then add probe, for example: add probe on src_bin_muxer after create_multi_source_bin.
the file path of create elements is deepstream\deepstream\sources\apps\apps-common, these code are opensource, you can add probe on element, for example: add probe on bin->streammux in create_multi_source_bin.
I know it is not a probe. I first wanted to check if this is the right place and then attach the probe. But this function code (create_multi_source_bin) runs only to create pipeline elements at the beginning. It runs only once.
This element is not visited constantly, meaning I can’t check the component’s latency while it is analyzing frames.
Would it be possible to get the timestamps for running components of the pipeline using custom probes? Would that be possible?
Thank you for your response. I have been struggling with implementing the function inside streammux. I am trying to replicate similar to osd_sink_pad_buffer_probe of deepstream-test1. There are some work left.