Controlling robot movement with mouse clicks in Isaac Sim

Is it possible to set up wheel robot movement control with a mouse click, like in strategy games where you click on a point with the mouse, and the character moves to that point? Or maybe there are some other simple ways to control the robot’s movement in the environment?

Hello! we don’t have anything out of the box with this functionality, but it should be possible to write an extension to couple a point-and-click to a path planner, which would drive wheeled robot controller to the target position. We do have some of the pieces for this ready, it would be a matter of combining them in the right way :)

@rgasoto Thanks, I got it, I’ve looked at the source code but I can’t find how to get mouse click coordinate in the world frame