I want to make the best balance between an image got from real world and a render image from isaac sim.
I’ve customized isaac sim with light postion/intensity/… and many object material things, so far.
However, It seems to hard to make the two images as similar as possible.
To do this, I’m researching lux measurement on the object surface in isaac sim, as the first step.
I’m quite not sure, this is the first step to make the two images as similar as possible.
It would be nice if you could give me directions on how to use isaac sim. If there is a better way to set up two images to make them similar, I’d welcome it.
thanks for advance.
@along893 i am just another user, but if you are not bound by any NDAs, attaching/posting the two images you mentioned (real world and from Issac Sim) might give the devs more context of what you are trying to match. and, in return, allow them to better assist you with specific params to tweak.
Hi @along893 - Balancing real-world images and rendered images from a simulation like Isaac Sim can indeed be challenging due to the differences in lighting, materials, and other environmental factors. Here are some steps you can take to make the images as similar as possible:
- Lighting: As you’ve already done, adjusting the position, intensity, and color of the lights in your simulation can help match the lighting conditions of your real-world images. You can also consider the type of light (point, directional, spot, etc.) and its properties (like attenuation and shadow quality).
- Materials: The appearance of objects in your simulation is heavily influenced by their materials. Try to match the materials of your simulation objects to those in the real world as closely as possible. This includes properties like color, texture, reflectivity, transparency, and roughness.
- Camera Settings: The camera settings can also affect the appearance of your rendered images. Try to match the field of view, exposure, white balance, and other settings of your simulation camera to your real-world camera.
- Environment: If possible, try to recreate the environment of your real-world images in your simulation. This includes the sky, ground, and any other large objects that might affect lighting and reflections.
- Post-Processing: You can also use post-processing effects to adjust the final appearance of your rendered images. This can include adjustments to contrast, saturation, brightness, and other image properties.
As for measuring lux on the object surface in Isaac Sim, while there isn’t a built-in tool for this, you could potentially use a light probe or similar technique to estimate the amount of light falling on a surface. However, this might require some custom scripting or programming.
Thank you for the steps, @rthaker.
I’m interested in the code example (ex.python) that demonstrates how to use a light probe to measure lux on the surface of an object.
Do you have any examples to share? or would you just provide me with the URL for the “omni” library?
that would be very helpful. I’ll figure it out from there.