How to set the msg-broker if use my own model when running the code of deepstream_paraller_infer

Please provide complete information as applicable to your setup.
• Hardware Platform (Jetson / GPU)
GPU with Tesla T4
• DeepStream Version
Docker images with deepstream6.1.1-triton
• JetPack Version (valid for Jetson only)
• TensorRT Version
• NVIDIA GPU Driver Version (valid for GPU only)
Driver Version: 515.65.01 CUDA Version: 11.7
• Issue Type( questions, new requirements, bugs)
I try to send the msg detect from my own model, but it seems that I can not get the correct information. Here I provide the setting and msg details from kafka:
setting details:

msg detail:

Thanks in advance!

can you check if generate_event_msg_meta is called? and nvmsgconv and nvmsgbroker are opensource, please add logs to check if position is null.

Thanks for your reply. If I changed the setting of msg-conv-msg2p-new-api to be 0, And I got the different result:

And I also check the video saved , it seems the detection with labels and boxes are correct.

could you share the whole media pipeline? is there vehicle classification in the model? please add logs to check where is vehicle classification from.

I do not set the vehicle classification in the model, but just two models of myself.
I have checked the official command successfully, but failed in replace the setting to my own models.
And here is my setting:
dec_parallel_infer.yml (6.5 KB)

To narrow this issue, please add logs in generate_event_message_minimal in opt\nvidia\deepstream\deepstream\sources\libs\nvmsgconv\deepstream_schema\eventmsg_payload.cpp, rebuild the code according to /opt/nvidia/deepstream/deepstream/sources/libs/nvmsgconv/README, you can backup the old /opt/nvidia/deepstream/deepstream/lib/, then replace the old lib.

I have check the eventmsg_payload.cpp,and find it works correctly. So I do not rebuild the
And I tried to add the print function to check whether I got the correct detection data, and it seems worked. But I still can’t find the position data in kafka。。


I’m confused how to send the detection data to kafka, could you show me the code position?thanks

I just follow your suggestion by rebuild the lib, but just add the log setting at dsmeta_payload.cpp not eventmsg_payload.cpp because I found my setting of msg-conv-msg2p-new-api to be 1 in the sink.
And the results are shown below:
add the print log in function of osd_sink_pad_buffer_probe in deepstream_parallel_infer_app.cpp

add the print log in function of generate_dsmeta_message_minimal in dsmeta_payload.cpp:

thanks for the update, to narrow down this issue, please check why scaleW and scaleH are zero.

I’m still confused on it
Could you help to clarify how to get the frame source with and height? I found it to be kept zero.
And I will try to follow this code to find the reason. It is really hard to understand the data of pipeline became zero suddenly after checking some frames.

I will check why frame_meta->source_frame_width and frame_meta->source_frame_height are zero.

after nvmultistreamtiler, the frame meta info including source dimensions will dumped, you can add probe on nvmultistreamtiler sink and src to confirm.
currently, there are two solutions.

  1. use msg-conv-msg2p-new-api =0.
  2. use msg-conv-msg2p-new-api = 1, msgconv plugin needs to be in front of nvmultistreamtiler, as the comments in source4_1080p_dec_parallel_infer.yml said, " sink type = 6 by default creates msg converter + broker. To use multiple brokers use this group for converter and use sink type = 6 with disable-msgconv : 1", please set disable-msgconv: 1, and enable message-converter.

Thanks! I had set the msg-conv-msg2p-new-api =0 before, and got the correct position data and wrong label (all the labels are Vehicle). I had provided the snapshot before.

I will try the second solution to see if it works.

Here is the result of solution 2, and I still get no data for the position:


  1. please dump the gstreamer pipeline graph to check if msgconv is in front of tiler.
  2. if msgconv is in front of tiler, the frame_meta->source_frame_width and frame_meta->source_frame_height should not be zero, then scaleW will not be zero, please add logs to check.

Sorry, how to dump the gstreamer pipeline graph ? I’m not clear about it…

please refer to :DeepStream SDK FAQ - #10 by mchi

it is not clear, please attach zip, and if msgconv is in front of tiler, the frame_meta->source_frame_width and frame_meta->source_frame_height should not be zero, then scaleW will not be zero, please add logs to check. (1.5 MB)