Hello, Jetson Community!
We’d like to introduce our project for real-time vSLAM with CNN and NVIDIA Jetson. Our main goal was to study different CNN architectures and techniques for depth reconstruction from single image. We evaluated all the developed algorithms (including custom layers) on NVIDIA Jetson TX2 with TensorRT to keep the balance between depth reconstruction quality and real-time performance.
Then, we used the developed CNN architectures as a part of RTAB-MAP (http://wiki.ros.org/rtabmap_ros) vSLAM algorithm pipeline to estimate the position of the moving Jetson TX2 and build the 3D map of unknown indoor environment.
This project is still work-in-progress and is a part of bigger academic research project for autonomous multi-robot vision-based SLAM, exploration, pathplanning and navigation with Jetsons, that is coming this year.
The code and models are free and open-source.
Paper: Real-time Vision-based Depth Reconstruction with NVidia Jetson | IEEE Conference Publication | IEEE Xplore
[1907.07210] Real-time Vision-based Depth Reconstruction with NVidia Jetson
Repository: GitHub - CnnDepth/tx2_fcnn_node: ROS node for real-time FCNN depth reconstruction
Video:
Feel free to use this project, contribute and ask any questions.
- Andrey