Hi all,
I wonder whether it is possible to visualise images not coming directly from the cameras using (that is, processed in some way) on Isaac Sim’s viewports. For context, I am working on Isaac sim 4.2.0 using client/server livestream on a AWS server, which allows me to see the main GUI, but I can’t visualise any other windows. I wrote a script where I retrieve an image from a camera, and I want to get image from a camera, process it, and visualise the result, but because of the client/server approach, I can’t open openCV or matplotlib windows as I would do normally. In essence, I would like to replicate the code in this tutorial: Camera Sensors and Render Extensions — Omniverse IsaacSim, and be able to visualise the image.
The intuitive solution for me would be to use the embedded viewports from IsaacSim to visualise the processed image, in the same way I can view the camera stream. Is it even possible? If so, how would I go around doing it? If it’s not, what would be the best alternative to visualise processed images?