Abstract:Existing unsupervised monocular depth estimation methods resort to stereo image pairs instead of ground-truth depth maps as supervision to predict scene depth. Constrained by the type of monocular input in testing phase, they fail to fully exploit the stereo information through the network during training, leading to the unsatisfactory performance of depth estimation. Therefore, we propose a novel architecture which consists of a monocular network (Mono-Net) that infers depth maps from monocular inputs, and a stereo network (Stereo-Net) that further excavates the stereo information by taking stereo pairs as input. During training, the sophisticated Stereo-Net guides the learning of Mono-Net and devotes to enhance the performance of Mono-Net without changing its network structure and increasing its computational burden. Thus, monocular depth estimation with superior performance and fast runtime can be achieved in testing phase by only using the lightweight Mono-Net. For the proposed framework, our core idea lies in: 1) how to design the Stereo-Net so that it can accurately estimate depth maps by fully exploiting the stereo information; 2) how to use the sophisticated Stereo-Net to improve the performance of Mono-Net. To this end, we propose a recursive estimation and refinement strategy for Stereo-Net to boost its performance of depth estimation. Meanwhile, a multi-space knowledge distillation scheme is designed to help Mono-Net amalgamate the knowledge and master the expertise from Stereo-Net in a multi-scale fashion. Experiments demonstrate that our method achieves the superior performance of monocular depth estimation in comparison with other state-of-the-art methods.

Connecting The Dots: Learning Representations For Active Monocular Depth Estimation

Monocular Depth Estimation Based on Unsupervised Learning

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

Depth Estimation from Monocular Images Using Dilated Convolution and Uncertainty Learning.

Depth Estimation by Combining Binocular Stereo and Monocular Structured-Light

Unsupervised Monocular Depth Estimation for Monocular Visual SLAM Systems

Learning Depth for Scene Reconstruction Using an Encoder-Decoder Model

Structure-Centric Robust Monocular Depth Estimation via Knowledge Distillation

A Lightweight Self-Supervised Training Framework for Monocular Depth Estimation

DepthFormer: Exploiting Long-range Correlation and Local Information for Accurate Monocular Depth Estimation

Triaxial Squeeze Attention Module and Mutual-Exclusion Loss Based Unsupervised Monocular Depth Estimation

Digging Into Self-Supervised Monocular Depth Estimation

Self-Supervised Monocular Depth Estimation Based on High-Order Spatial Interactions

Unsupervised Monocular Depth Estimation Via Recursive Stereo Distillation.

Depth Monocular Estimation with Attention-based Encoder-Decoder Network from Single Image

Unsupervised Monocular Depth Estimation with Encoder-decoder Network

Learning Monocular Depth by Distilling Cross-domain Stereo Networks

Self-supervised Monocular Depth Estimation with Multi-Scale Structure Similarity Loss

Depth Is All You Need for Monocular 3D Detection

Wearable Depth Camera: Monocular Depth Estimation Via Sparse Optimization under Weak Supervision.