@squirantes i am just another user and have not tried to do this myself. that said, i do recall an older thread that may or may not be helpful:
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Get world coordinates of the point where mouse clicks in viewport | 1 | 226 | June 2, 2025 | |
| How can I get mouse location in world coordinates? | 5 | 302 | January 28, 2025 | |
| Projection of Mouse Click Location to World Coordinate | 5 | 1178 | September 13, 2022 | |
| Mouse Coords in World Coords | 2 | 734 | June 14, 2022 | |
| Spacemouse input in Isaac SIM (and other omniverse apps) | 7 | 1162 | April 5, 2024 | |
| Is there an easy way to look at world coordinates of a prim which is nested below other off-setted Xforms in Isaac Sim? | 3 | 659 | October 26, 2023 | |
| How to align the virtual world with real-world coordinates(e.g. latitude and longitude )? | 7 | 993 | October 12, 2024 | |
| How to transform pixel coordinate to camera coordinate | 5 | 2077 | August 22, 2023 | |
| Controlling robot movement with mouse clicks in Isaac Sim | 2 | 522 | March 24, 2024 | |
| Camera pose in world frame via python | 6 | 1356 | April 12, 2024 |