I am extending your point cloud code to a scenario where I have multiple environments running in parallel. Even though I used the exact same set up for each environment, the generated point clouds are not the same.
To be exact, the point clouds of the first env and second environments are 2 meters apart (see image below for visualization in open3D and pptk). I also printed out the
points matrices and confirmed that they’re different.
I realized that this line of your code prints out different matrices for different environments.
vinv = np.linalg.inv(np.matrix(gym.get_camera_view_matrix(sim, env, cam_handles[c]))) Shouldn’t the camera view matrix be the same for all environments, given that the setups are the same? I believe that this is the main cause of the issue
Please see below for my code which creates two separate point clouds for two environments. Please advise me on a good way to generate point clouds in multiple environments.
test_point_cloud_multiple_scences.py (8.8 KB)
Thanks a lot,