Abstract:In recent years, with the vigorous development of artificial intelligence and autonomous driving technology, the importance of scene perception technology is increasing. Unsupervised deep learning based methods have demonstrated a certain level of robustness and accuracy in some challenging scenes. By inferring depth from a single input image without any ground truth label, a lot of time and resources can be saved. However, unsupervised depth estimation has defects in robustness and accuracy under complex environment which could be improved by modifying network structure and incorporating other modal information. In this paper, we propose an unsupervised, monocular depth estimation network achieving high speed and accuracy, and a learning framework with our depth estimation network to improve depth performance by incorporating transformed images across different modalities. The depth estimator is an encoder-decoder network to generate the multi-scale dense depth map. The sub-pixel convolutional layer is adopted to obtain depth super-resolution by replacing the up-sample branches. The cross-modal depth estimation using near-infrared image and RGB image enhances the performance of depth estimation than pure RGB image. The training mode is to transfer both images to the same modality and then carry out super-resolved depth estimation for each stereo camera pair. Compared with the initial results of depth estimation using only RGB images, the experiment verifies that our depth estimation network with the cross-modal fusion system designed in this paper achieves better performance on public datasets and a multi-modal dataset collected by our stereo vision sensor.

Un-VDNet: Unsupervised Network for Visual Odometry and Depth Estimation.

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

Monocular Depth Estimation Based on Unsupervised Learning

CodeVIO: Visual-Inertial Odometry with Learned Optimizable Dense Depth

Visual Odometry Based on Convolutional Neural Networks for Large-Scale Scenes

Region Deformer Networks for Unsupervised Depth Estimation from Unconstrained Monocular Videos

Unsupervised Ego-Motion and Dense Depth Estimation with Monocular Video

Unsupervised Monocular Estimation of Depth and Visual Odometry uUsing Attention and Depth-Pose Consistency Loss

Unsupervised Monocular Visual-Inertial Odometry Network

Unsupervised Monocular Depth Estimation for Monocular Visual SLAM Systems

MuDeepNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Pose Using Multi-view Consistency Loss

DevNet: Self-supervised Monocular Depth Learning Via Density Volume Construction

GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Pose

Unsupervised Learning of Dense Optical Flow, Depth and Egomotion from Sparse Event Data

Unsupervised Deep Learning-Based RGB-D Visual Odometry

Unsupervised Scale Network for Monocular Relative Depth and Visual Odometry

Unsupervised Learning of Monocular Depth and Large-Ego-Motion with Multiple loop consistency losses

A Novel End-to-End Visual Odometry Framework Based on Deep Neural Network

Twinvo: Unsupervised Learning of Monocular Visual Odometry Using Bi-Direction Twin Network

Unsupervised Learning of Monocular Depth and Ego-motion in Outdoor/Indoor Environments

Unsupervised Deep Persistent Monocular Visual Odometry and Depth Estimation in Extreme Environments