Payload-type: 1 not working as expected

Accelerated Computing Intelligent Video Analytics DeepStream SDK
1

Description

PAYLOAD_DEEPSTREAM_MINIMAL not sending all objects when msg2p-newapi set to 0.

Environment

Hardware Platform: GPU
Deepstream: 7.0
Docker Image: 7.0-triton-multiarch
GPU Type: A4000

I want to send every object on a single payload without sending images. Working on deepstream-test4
Examples:
Config 1: Sends only 1 bbox and frame-interval not work
msgconv:
#If you want to send images, please set the “payload-type: 1” and “msg2p-newapi: 1”
payload-type: 1
msg2p-newapi: 0
frame-interval: 1
Output
{
“version” : “4.0”,
“id” : “0”,
“@timestamp” : “2024-09-17T11:30:45.142Z”,
“sensorId” : “sensor-0”,
“objects” : [
“18446744073709551615|437.749|481.778|462.833|544.949|Person|0.5312|#|male|45|black|none|formal”
]
}

Config 2: Sends all objects, frame-interval works but also sends base64 image every multiples of id 30.

msgconv:
#If you want to send images, please set the “payload-type: 1” and “msg2p-newapi: 1”
payload-type: 1
msg2p-newapi: 1
frame-interval: 1
Output
{
“version” : “4.0”,
“id” : “0”,
“@timestamp” : “2024-09-17T12:02:29.838Z”,
“sensorId” : “CAMERA_ID”,
“objects” : [
“18446744073709551615|437.749|481.778|462.833|544.949|person”,
“18446744073709551615|129.997|481.135|207.001|769.035|person”,
“18446744073709551615|1.92141|395.212|199.424|1030.46|person”,
“18446744073709551615|297.117|446.868|476.383|862.299|person”,
“18446744073709551615|463.402|485.014|487.005|554.531|person”,
“18446744073709551615|658.534|460.623|681.881|483.395|car”,
“18446744073709551615|476.93|481.18|504.63|508.73|car”,
“18446744073709551615|657.446|464.462|698.492|491.386|car”,
“18446744073709551615|737.556|230.606|1677.46|1009.09|car”,
“18446744073709551615|465.809|481.367|500.363|526.993|car”,
“18446744073709551615|609.57|466.984|664.726|493.98|car”,
“18446744073709551615|522.588|463.715|553.146|482.093|car”,
“18446744073709551615|612.948|484.086|722.215|569.402|car”,
“18446744073709551615|597.1|470.953|663.752|529.316|car”,
“18446744073709551615|554.704|471.7|601.489|521.158|car”
],
“customMessage” : [
“image;jpg;25.083740x63.171619;2024-09-17T12:02:29.813Z;base64_img”
]

Also created a custom payload using /opt/nvidia/deepstream/deepstream/sources/libs/nvmsgconv/deepstream_schema/eventmsg_payload.cpp. Edited generate_event_message_minimaland copied compiled libnvds_msgconv.so to deepstream/lib/. Faced the same issue. When msg2p-newapi: 0 I was only able to get 1 bbox, when msg2p-newapi: 1 it overrided my custom library and sended same message given above.

Expected this
{
“id”: “12345”,
“@timestamp”: “2018-04-11T04:59:59.828Z”,
“boxes”: [
[50, 100, 200, 250],
[30, 60, 180, 220],
[40, 90, 170, 210]
…
…
…
]
}
but i get
{
“id”: “12345”,
“@timestamp”: “2018-04-11T04:59:59.828Z”,
“boxes”: [
[50, 100, 200, 250] // only one bbox everytime
]
}

I need to send all bboxes on a single message with frame-interval feature. Thanks!

3

if you want to send all objects in one message, please set payload-type to 1. about " but also sends base64 image every multiples of id 30.", it is a sending jpg feature in test4. you can disable adding user meta for meta_type NVDS_CUSTOM_MSG_BLOB in osd_sink_pad_buffer_image_probe, then rebuild test4.

4

Achieved what i want using deepstream-test5 app. But deepstream-test4 still doesn’t send all bboxes when i use settings payload-type: 1 and msg2p-newapi: 0.

5

please refer to the doc for the explanation of msg2p-newapi: 0. if msg2p-newapi is 0, you need to add user_event_meta. please refer to generate_event_msg_meta in bbox_generated_probe_after_analytics o test5.

6

There is no update from you for a period, assuming this is not an issue anymore. Hence we are closing this topic. If need further support, please open a new one. Thanks

7

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.