Hi,
How can I create a maize or sorghum field, environment, and train a robot on my field data ?
Can we built It using UAV data or backpack data (sensors) ?
Any thoughts on it is much appreciated>
Hello @vinaychaudhari02,
Welcome to the Isaac ROS forum and thanks for the post!
Yes, UAV or backpack sensor data can be used as part of this workflow.
At a high level, you can:
-
Create or import the farm terrain and crop assets into Isaac Sim as an OpenUSD scene, then add the robot and simulated sensors for testing.
-
Connect Isaac Sim to the robot’s ROS 2 software through the ROS 2 Bridge.
-
On the real UAV or backpack system, record camera, depth/LiDAR, IMU, pose, and TF topics using ros2 bag.
-
Use Isaac ROS Visual SLAM for pose estimation and Isaac ROS nvblox for local depth/LiDAR-based 3D reconstruction and navigation mapping.
-
To reproduce the real field in Isaac Sim, process the recorded survey data into a terrain or textured mesh, convert it to USD, and add appropriate collision geometry.
Useful references:
-
Isaac Sim ROS 2 workflow and environment setup ( ROS 2 Reference Architecture — Isaac Sim Documentation )
-
Isaac Sim ROS 2 tutorials ( Overview and Installation — Isaac Sim Documentation )
-
Isaac ROS nvblox ( Isaac ROS Nvblox — Isaac ROS )
-
Isaac Lab terrain generation and import ( isaaclab.terrains — Isaac Lab Documentation )