Deepstream python code need to display gender age and pose

[metalhead235711]

Hello everyone , i am new to deepstream and i am trying to combine these two github code

• this one where i get the age and gender detection https://github.com/bharath5673/Deepstream/blob/main/DeepStream-Python/deepstream_test_yolo_track_multimodel.py
• and this one for pose detection
  https://github.com/YunghuiHsu/deepstream-yolo-pose/blob/main/deepstream_YOLOv8-Pose_rtsp.py
  i tried to make it in one whole code but i have a problem regarding displaying the pose and the bounding box as follow person id gender: … age : …
  also i need to send these metadata to kafka as json format that will contain id of the person detected , its gender, its age, its keypoints , the frame_number etc .
  my code is below :
  deepstream.txt (25.5 KB)
  Also, i dont know why but the stream get blocked in the first frame although it printed out the frames in the terminal

[yuweiw]

You mean the print is fine, but the display can only show the first frame? Could you attach the log with GST_DEBUG=3 ?

[metalhead235711]

thank you for your response.
when i run it be displaying like this

like it just get stuck like that.
also that’s it showed those warning between 2 streams
**PERF: {‘stream0’: 7.01}

Frame Number=195 Person_count=2 Male_count=1 Female_count=3
0:00:51.378788252 6735 0x7ef4006b20 ERROR v4l2bufferpool gstv4l2bufferpool.c:747:gst_v4l2_buffer_pool_alloc_buffer:nvv4l2decoder0:pool:src failed to allocate buffer
0:00:51.378844501 6735 0x7ef4006b20 WARN bufferpool gstbufferpool.c:310:do_alloc_buffer:nvv4l2decoder0:pool:src alloc function failed
0:00:51.378893562 6735 0x7ef4006b20 ERROR v4l2bufferpool gstv4l2bufferpool.c:747:gst_v4l2_buffer_pool_alloc_buffer:nvv4l2decoder0:pool:src failed to allocate buffer
0:00:51.378928926 6735 0x7ef4006b20 WARN bufferpool gstbufferpool.c:310:do_alloc_buffer:nvv4l2decoder0:pool:src alloc function failed
0:00:51.379064444 6735 0x7ef4006b20 ERROR v4l2bufferpool gstv4l2bufferpool.c:747:gst_v4l2_buffer_pool_alloc_buffer:nvv4l2decoder0:pool:src failed to allocate buffer
0:00:51.379090694 6735 0x7ef4006b20 WARN bufferpool gstbufferpool.c:310:do_alloc_buffer:nvv4l2decoder0:pool:src alloc function failed
0:00:51.379112881 6735 0x7ef4006b20 ERROR v4l2bufferpool gstv4l2bufferpool.c:747:gst_v4l2_buffer_pool_alloc_buffer:nvv4l2decoder0:pool:src failed to allocate buffer
0:00:51.379131943 6735 0x7ef4006b20 WARN bufferpool gstbufferpool.c:310:do_alloc_buffer:nvv4l2decoder0:pool:src alloc function failed
0:00:51.379152359 6735 0x7ef4006b20 ERROR v4l2bufferpool gstv4l2bufferpool.c:747:gst_v4l2_buffer_pool_alloc_buffer:nvv4l2decoder0:pool:src failed to allocate buffer
0:00:51.379170796 6735 0x7ef4006b20 WARN bufferpool gstbufferpool.c:310:do_alloc_buffer:nvv4l2decoder0:pool:src alloc function failed
0:00:51.379190014 6735 0x7ef4006b20 ERROR v4l2bufferpool gstv4l2bufferpool.c:747:gst_v4l2_buffer_pool_alloc_buffer:nvv4l2decoder0:pool:src failed to allocate buffer
0:00:51.379207566 6735 0x7ef4006b20 WARN bufferpool gstbufferpool.c:310:do_alloc_buffer:nvv4l2decoder0:pool:src alloc function failed
0:00:51.379226680 6735 0x7ef4006b20 ERROR v4l2bufferpool gstv4l2bufferpool.c:747:gst_v4l2_buffer_pool_alloc_buffer:nvv4l2decoder0:pool:src failed to allocate buffer
0:00:51.379244232 6735 0x7ef4006b20 WARN bufferpool gstbufferpool.c:310:do_alloc_buffer:nvv4l2decoder0:pool:src alloc function failed
Frame Number=196 Person_count=2 Male_count=1 Female_count=3
Frame Number=197 Person_count=2 Male_count=1 Female_count=2

[yuweiw]

OK. Could you provide complete information as applicable to your setup? Thanks
Hardware Platform (Jetson / GPU)
DeepStream Version
JetPack Version (valid for Jetson only)
TensorRT Version
NVIDIA GPU Driver Version (valid for GPU only)
Issue Type( questions, new requirements, bugs)
How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)
Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)

[metalhead235711]

of course. here is it :
Hardware Platform (Jetson / GPU) : Jetson nano 4gb
DeepStream Version : 6.0.1
JetPack Version (valid for Jetson only) : 4.6.1
TensorRT Version : 8.2.1.8
Issue Type( questions, new requirements, bugs) : the Stream get stuck in the first frame although the metadata is printing in the terminal. i tried as i said above combining the three models (age,gender,pose detection) and i got that error also how can i send the metadata related to the person detected (age , gender, the keypoints)in json format

[yuweiw]

Since you are using Jetson nano, it could be a performance problem. Could you try to set Interval parameter to the nvinfer? You can refer to the Gst-nvinfer Gst Properties.

[metalhead235711]

yess you were right, the stream is no longer stuck , but also i get no detection

[yuweiw]

Because your board runs these 3 models with a heavy loading, we have to skip some frames with the interval parameter. It’s normal that there are no detections for the skipped frames.

[yingliu]

There is no update from you for a period, assuming this is not an issue anymore. Hence we are closing this topic. If need further support, please open a new one. Thanks