Looking at the camera api, it’s not direct to find the best way to collect pixels from the viewport/camera inside an extension … did you already tested it ? First looking at Movie Capture — Omniverse Create documentation (nvidia.com)

Hi @didjich ! Thanks for your question. I have contacted the team for more help here. I will post back when I have more information!

Hi @didjich , if you want to an API to save what’s in the viewport into a file, you can use the omni.kit.capture extension. You can find it under “\kit\exts\omni.kit.capture” of your Create package. And of course you can refer to the Movie Capture extension to see how to use omni.kit.capture. The M…

Is there a way to capture the view from an arbitrary camera? Not the viewport.

Thanks @quchen . Effectively, enabling the extension “Kit Image and Video Capture” and exploring the code is the way I take actually, but maybe something like a node or another way could be available too. (A remark that could help users, you have a button to directly open the code like in this ima…

Yeah the Open button is handy. So the function to actually capture an image is this one: def _capture_viewport(self, frame_path: str): viewport_window = self._viewport_interface.get_viewport_window(None) def _capture_helper(viewport_rp_resource): self._renderer.capture_…

@quchen After some test, I go to use the omni.syntheticdata extension. It provides both C++ and python bindings that allow users to extract ground truth data from scenes loaded and rendered … here https://docs.omniverse.nvidia.com/prod_extensions/prod_extensions/ext_synthetic-data.html

A remark in connection with this post… Simple render USD scene to PNG - #11 by didjich

The best way to collect pixels from viewport/camera in an extension

Omniverse Archive General Discussion

didjich January 27, 2022, 10:58pm 8

see here too about Replicator Issac Sim Replicator Generate Synthetic data avaliability - #4 by didjich

Topic		Replies	Views
How can I grab the Viewport or the Camera rendering in a python script? General Discussion	2	1437	January 3, 2023
Save an image from the viewport of a camera in Isaac Sim Isaac Sim kb	4	4093	December 21, 2024
Viewport capture from within another extension? General Discussion	1	191	June 5, 2024
Can i capture movie using only python api? Audio2Face (closed)	2	900	April 7, 2022
How do I render and save a png image with python? General Discussion camera , python	1	1496	September 15, 2023
Viewport capture from within another extension? Isaac Sim	3	226	June 4, 2024
Does Create Movie Capture support multi camera? Samples & Examples	12	1161	June 14, 2024
Saving USD scene to PNG file using Python General Discussion	12	1772	October 23, 2023
Saving viewport image with SceneView drawing General Discussion	1	574	September 14, 2022
Export frames from viewport to OpenCv or python in realtime Audio2Face (closed)	6	1699	February 18, 2022

The best way to collect pixels from viewport/camera in an extension

Related topics