Abstract:In recent years, with the vigorous development of artificial intelligence and autonomous driving technology, the importance of scene perception technology is increasing. Unsupervised deep learning based methods have demonstrated a certain level of robustness and accuracy in some challenging scenes. By inferring depth from a single input image without any ground truth label, a lot of time and resources can be saved. However, unsupervised depth estimation has defects in robustness and accuracy under complex environment which could be improved by modifying network structure and incorporating other modal information. In this paper, we propose an unsupervised, monocular depth estimation network achieving high speed and accuracy, and a learning framework with our depth estimation network to improve depth performance by incorporating transformed images across different modalities. The depth estimator is an encoder-decoder network to generate the multi-scale dense depth map. The sub-pixel convolutional layer is adopted to obtain depth super-resolution by replacing the up-sample branches. The cross-modal depth estimation using near-infrared image and RGB image enhances the performance of depth estimation than pure RGB image. The training mode is to transfer both images to the same modality and then carry out super-resolved depth estimation for each stereo camera pair. Compared with the initial results of depth estimation using only RGB images, the experiment verifies that our depth estimation network with the cross-modal fusion system designed in this paper achieves better performance on public datasets and a multi-modal dataset collected by our stereo vision sensor.

A Survey of Depth Estimation Based on Computer Vision

Depth Estimation Methods Based on Computer Vision

Binocular Depth Estimation Using Convolutional Neural Network With Siamese Branches.

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

Monocular Depth Estimation Based on Unsupervised Learning

Research progress of depth detection in vision measurement: A novel project of bifocal imaging system for 3D measurement

Monocular Depth Estimation Based on Deep Learning:A Survey

A Survey on Deep Learning Techniques for Stereo-based Depth Estimation

Survey of 3D Modeling Using Depth Cameras.

Depth Estimation from Monocular Images Using Dilated Convolution and Uncertainty Learning.

A Depth Extraction Method Based on Motion and Geometry for 2D to 3D Conversion

Visual Perception Theory Guided Image Perceptual Depth Estimation

Deep Learning based Monocular Depth Prediction: Datasets, Methods and Applications

Monocular Depth Estimation: A Survey

The Depth Estimate of Interesting Points from Monocular Vision

Depth Estimation System Suitable for Hardware Design

Towards Real-Time Monocular Depth Estimation for Robotics: A Survey

Depth Image Application in Analysis of Automatic 3D Reconstruction

Recent Advances in Conventional and Deep Learning-Based Depth Completion: A Survey

Monocular depth estimation based on deep learning: An overview

Depth Insight -- Contribution of Different Features to Indoor Single-image Depth Estimation