Camera + LiDAR Solution in Deepstream

[zyctimes]

Please provide complete information as applicable to your setup.

• Hardware Platform: Jetson Nano Developer Kit
• DeepStream Version: 5.0
• JetPack Version: 4.4
• TensorRT Version: 7.1.0

Hi Sir/Madam:
This is just a suggestion.
During the industrial project of machine vision on my side, I really see more and more requirements which combines camera and LiDAR. Camera is used to give back object detection data, and LiDAR is used to provide depth data (at least). I see Nvidia Driveworks has similar stuff, but that platform is mainly used for autonomous driving.
I am wondering whether it is possible that Deepstream in the future could support several LiDAR. That will be quite helpful for some industrial implementation.
Thanks a lot for your attention.

Best

[mchi]

Thanks for your great suggestion!

Yes, we don’t have GST plugin to process Lidar data.
For now, user needs to develop the plugin to process Lidar data in parallel with the video data, and then fuse them.
For now, DS does not have the plugins for PCL and fusion.