Accessing thermal information in deepstream

Accelerated Computing Intelligent Video Analytics DeepStream SDK
1

Currently I am working on enabling rgb and thermal imaging sensors as live source in deepstream.

Here are the list of questions.

  1. Here the thermal imaging sensors produce output with GRAY16_LE format, whereas nvstreammux uses NV12, RGBA, I420 formates. How to convert GRAY16_LE → RGBA → GRAY16_LE ?
  2. How to differentiate the source path where the pgie and sgie runs using rgb live source and uses thermal source only to extract information on the detected bounding boxes.
  3. How to access thermal source information in src_pad_buffer_probe function to extract temps around object bounding box.

Any suggestions on how to do this?

Thank you,

Please provide complete information as applicable to your setup.

• Hardware Platform (Jetson / GPU) Jetson
• DeepStream Version 6.2
• JetPack Version (valid for Jetson only) 5.1.1
• Issue Type( questions, new requirements, bugs)
• How to reproduce the issue ? (This is for bugs. Including which sample app is using, the configuration files content, the command line used and other details for reproducing)
• Requirement details( This is for new requirement. Including the module name-for which plugin or for which sample application, the function description)

3

You can use videoconvert to convert GRAY16_LE → RGBA and RGBA → GRAY16_LE

https://gstreamer.freedesktop.org/documentation/videoconvertscale/videoconvert.html?gi-language=c

4

There is no update from you for a period, assuming this is not an issue anymore. Hence we are closing this topic. If need further support, please open a new one. Thanks

Can you elaborate your requirement? If you don’t need the thermal source to be inferenced, just do not input the thermal source to the inferencing pipeline.

Can you show us your pipeline and how did you want to extract information with the thermal source ?

5

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.