[FoundationPose with Isaac Sim] Issue with Mask Detection

[component_container_mt-1] 2025-02-17 12:57:42.337 ERROR ./gxf/foundationpose/foundationpose_sampling.cpp@483: [FoundationposeSampling] Failed to guess translation. Not processing this image
[component_container_mt-1] 2025-02-17 12:57:42.343 ERROR ./gxf/foundationpose/foundationpose_sampling.cpp@269: [FoundationposeSampling] No valid value in mask.
[component_container_mt-1] 2025-02-17 12:57:42.343 ERROR ./gxf/foundationpose/foundationpose_sampling.cpp@483: [FoundationposeSampling] Failed to guess translation. Not processing this image
[component_container_mt-1] 2025-02-17 12:57:42.348 ERROR ./gxf/foundationpose/foundationpose_sampling.cpp@269: [FoundationposeSampling] No valid value in mask.
[component_container_mt-1] 2025-02-17 12:57:42.348 ERROR ./gxf/foundationpose/foundationpose_sampling.cpp@483: [FoundationposeSampling] Failed to guess translation. Not processing this image
[component_container_mt-1] 2025-02-17 12:57:42.353 ERROR ./gxf/foundationpose/foundationpose_sampling.cpp@269: [FoundationposeSampling] No valid value in mask.
[component_container_mt-1] 2025-02-17 12:57:42.353 ERROR ./gxf/foundationpose/foundationpose_sampling.cpp@483: [FoundationposeSampling] Failed to guess translation. Not processing this image
[component_container_mt-1] 2025-02-17 12:57:42.358 ERROR ./gxf/foundationpose/foundationpose_sampling.cpp@269: [FoundationposeSampling] No valid value in mask.
[component_container_mt-1] 2025-02-17 12:57:42.358 ERROR ./gxf/foundationpose/foundationpose_sampling.cpp@483: [FoundationposeSampling] Failed to guess translation. Not processing this image

Hi there thanks for your work.
https://nvidia-isaac-ros.github.io/v/release-3.1/concepts/pose_estimation/foundationpose/tutorial_isaac_sim.html
I am following this tutorial but I get an error log as I pasted above.
As you can see in the photo you can see that I get a segmentation mask, and I could check in RVIZ that depth_image, front_stereo_camera/left/image_rect_color_resized,
front_stereo_camera/left/camera_info_resized ,
rt_detr_segmentation are all published well but I have no sense why it doesn’t get the mask… ,
From this note
" This tutorial detects the 3D pose of the Mac and Cheese Box mentioned in the SyntheticaDETR Object Classes section. In order to detect other objects from SyntheticaDETR Object Classes , you need to create a mesh and replace the mesh_file_path and texture_path arguments to this tutorials launch file with the mesh you generated. The tutorial on how to create a mesh using an iPhone can be found here. In order to detect other objects not supported by SyntheticaDETR , you will have to modify the launch file and replace the 2D object detection pipeline with one that supports the object you are trying to detect."

I changed the mesh_file_path and texture_path to my object, and then launched it, is there a problem here? After changing my launch file should I do some additional things?

+) I tested this FoundationPose with the Mac_n_cheese, not modifying the file path… still, not working and got the same error

Thank you for your post.

I forwarded internally your issue, I keep you posted

Best,
Raffaello