Isaac ROS with Intel Realsense D405 Stereo Vision Camera

Hello,

I am fairly new to Isaac ROS and I am trying to get an Intel Realsense D405 Stereo Vision Camera to work with some of the built in pose estimation packages, such as DOPE and FoundationPose. I have been able to build a container and generally get them to run when testing with a Rosbag. I am additionally able to run the FoundationPose model while using my D405 camera(and can run the realsense camera node and stream video through the Realsense Viewer), however there seems to be some sort of issue when actually applying FoundationPose to the video. I see on the supported camera list that the D405 camera is not mentioned, and the D415 is not supported. First, I am wondering if the D405 camera is supported. Second, I would like to know if there is an easy fix to provide data in the format that would have been expected if I was using one of the cameras that are listed as being supported. I can provide error messages and answer any troubleshooting related questions if so. Lastly, if there is likely to be support for additional camera models in the future.

If none of the above are viable, are there any alternative packages available for object pose estimation in ROS2? I have tried looking online, but have not been able to find anything.

1 Like

我目前也是,一直提示找不到usb相机。
除非我自己安装realsense-viewer最新版,但是这样,rqt可视化里面,就是空白,会报错:没有传入正确画面。

D405相机、jetson orin NX

另外,
我给D405刷入了指定要求的固件,在windows下的sdk一切正常,但是isaac ROS docker当中,它的realsense-viewer就无法完成初始化

Hi @1559003615

Thank you for your post, currently we didn’t test this camera, but please check if you have installed all right firmware and software

It is required to use RealSense firmware version 5.13.0.50, librealsense SDK version 2.55.1 and realsense-ros driver version 4.51.1-isaac. Any deviation from these versions will break Isaac ROS examples.

Please check if your camera is compatible with this realsense firmware.

Best,
Raffaello