We are trying to configure an RGB sensor in Isaac Sim to reflect the camera we are using in real life (Intel RealSense d455) and generate synthetic data.
However, the instructions are a bit confusing to us.
On the Isaac SDK documentation (Carter Warehouse example) you can add and configure a sensor by editing the carter_graph.json and carter_config.json
Also, on the Training Jetbot example by @HaiLocLu , he mentions:
“When we initially created the camera, we used default values for the FOV and simply angled it down at the road. This initial setup did not resemble the real camera image (Figure 12). We adjusted the FOV and orientation of the simulated camera (Figure 13) and added uniform random noise to the output during training. This was done to make the simulated camera view as much like the real camera view as possible.”
However, we are not able to figure out how to configure the RGB sensor to mimic our camera. We want to add an RGB sensor to mimic the Intel RealSense D455 camera which has the following specs:
- RGB frame resolution: Up to 1280 × 720 [is this the cols/rows parameter?]
- RGB frame rate: 30 fps [This has to be Frequency right?]
- RGB sensor technology: Global ShutterRGB sensor [is it possible to configure this?]
- FOV (H × V): 90 × 65° [there is an FOV parameter but not sure if this is the H or V one]
- RGB sensor resolution: 1 MP. [ does this not matter since we already defined the resolution above?]
We are not sure this configuration is even possible using Isaac Sim App, the tutorials seem to point to Isaac Sim SDK.
Any help on how to configure this sensor is appreciated.