Abstract:The RGB-D camera maintains a limited range for working and is hard to accurately measure the depth information in a far distance. Besides, the RGB-D camera will easily be influenced by strong lighting and other external factors, which will lead to a poor accuracy on the acquired environmental depth information. Recently, deep learning technologies have achieved great success in the visual SLAM area, which can directly learn high-level features from the visual inputs and improve the estimation accuracy of the depth information. Therefore, deep learning technologies maintain the potential to extend the source of the depth information and improve the performance of the SLAM system. However, the existing deep learning-based methods are mainly supervised and require a large amount of ground-truth depth data, which is hard to acquire because of the realistic constraints. In this paper, we first present an unsupervised learning framework, which not only uses image reconstruction for supervising but also exploits the pose estimation method to enhance the supervised signal and add training constraints for the task of monocular depth and camera motion estimation. Furthermore, we successfully exploit our unsupervised learning framework to assist the traditional ORB-SLAM system when the initialization module of ORB-SLAM method could not match enough features. Qualitative and quantitative experiments have shown that our unsupervised learning framework performs the depth estimation task comparable to the supervised methods and outperforms the previous state-of-the-art approach by $13.5\%$ on KITTI dataset. Besides, our unsupervised learning framework could significantly accelerate the initialization process of ORB-SLAM system and effectively improve the accuracy on environmental mapping in strong lighting and weak texture scenes.

Temporal-Aware SfM-Learner: Unsupervised Learning Monocular Depth and Motion from Stereo Video Clips.

Monocular Depth Estimation Based on Unsupervised Learning

Self-supervised Visual-LiDAR Odometry with Flip Consistency

Unsupervised Learning of Scene Flow Estimation Fusing with Local Rigidity.

Unsupervised Monocular Depth Estimation for Monocular Visual SLAM Systems

Unsupervised Learning of Monocular Depth and Large-Ego-Motion with Multiple loop consistency losses

Cycle-SfM: Joint Self-Supervised Learning of Depth and Camera Motion from Monocular Image Sequences.

Self-Supervised Learning of Monocular Visual Odometry and Depth with Uncertainty-Aware Scale Consistency

Unsupervised Learning of Depth and Pose Estimation Based on Continuous Frame Window.

Unsupervised Learning of Depth Estimation, Camera Motion Prediction and Dynamic Object Localization from Video

A Unified Unsupervised Learning Framework for Stereo Matching and Ego-Motion Estimation

Unsupervised Learning-based Depth Estimation aided Visual SLAM Approach

3D Hierarchical Refinement and Augmentation for Unsupervised Learning of Depth and Pose From Monocular Video

Unsupervised Deep Persistent Monocular Visual Odometry and Depth Estimation in Extreme Environments

Semantic and Optical Flow Guided Self-supervised Monocular Depth and Ego-Motion Estimation

Using Self-Supervised Depth and Uncertainty Predictions for Monocular Visual Odometry.

Self-supervised Monocular Depth and Visual Odometry Learning with Scale-consistent Geometric Constraints

Improving Unsupervised Learning of Monocular Depth and Ego-Motion Via Stereo Network

Spatial-temporal 3D dependency matching with self-supervised deep learning for monocular visual sensing

Unsupervised Learning of Depth and Ego-Motion with Spatial-Temporal Geometric Constraints

UnLearnerMC: Unsupervised Learning of Dense Depth and Camera Pose Using Mask and Cooperative Loss