Convert yolo pixel coordinates to robot coordinates in isaac sim

how to convert yolo pixel coordinates to robot coordinates and to make robot move in isaac sim.
in real world, i can use grid calibration to make pixel to convert world coordinates , but how to achieve in isaac sim

Hi @flluc Here are some tutorials about using yolo with Isaac Sim and Isaac ROS. Please check them out:

In order to convert yolo pixel coordinates to robot coordinates, you probably need depth information and camera calibration. Then you can convert the yolo pixel coordinates to camera coordinates, thus robot coordinates.

For your robot, is it an AMR or a robot arm? If it is a robot arm, please check out this tutorial for how to make it move:

For AMR, currently we only have tutorial for 2D space navigation:

1 Like

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.