Abstract:Depth estimation from a single image is an active research topic in computer vision. The most accurate approaches are based on fully supervised learning models, which rely on a large amount of dense and high-resolution (HR) ground-truth depth maps. However, in practice, color images are usually captured with much higher resolution than depth maps, leading to the resolution-mismatched effect. In this paper, we propose a novel weakly-supervised framework to train a monocular depth estimation network to generate HR depth maps with resolution-mismatched supervision, i.e., the inputs are HR color images and the ground-truth are low-resolution (LR) depth maps. The proposed weakly supervised framework is composed of a sharing weight monocular depth estimation network and a depth reconstruction network for distillation. Specifically, for the monocular depth estimation network the input color image is first downsampled to obtain its LR version with the same resolution as the ground-truth depth. Then, both HR and LR color images are fed into the proposed monocular depth estimation network to obtain the corresponding estimated depth maps. We introduce three losses to train the network: 1) reconstruction loss between the estimated LR depth and the ground-truth LR depth; 2) reconstruction loss between the downsampled estimated HR depth and the ground-truth LR depth; 3) consistency loss between the estimated LR depth and the downsampled estimated HR depth. In addition, we design a depth reconstruction network from depth to depth. Through distillation loss, features between two networks maintain the structural consistency in affinity space, and finally improving the estimation network performance. Experimental results demonstrate that our method achieves superior performance than unsupervised and semi-supervised learning based schemes, and is competitive or even better compared to supervised ones.

Reinforcing Local Structure Perception for Monocular Depth Estimation

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

Improving Monocular Depth Estimation by Leveraging Structural Awareness and Complementary Datasets

Monocular image depth estimation using dilated convolution and spatial pyramid polling structure

Structure-Centric Robust Monocular Depth Estimation via Knowledge Distillation

Depth Estimation from Monocular Images Using Dilated Convolution and Uncertainty Learning.

DepthFormer: Exploiting Long-range Correlation and Local Information for Accurate Monocular Depth Estimation

DCL-depth: monocular depth estimation network based on iam and depth consistency loss

SRNSD: Structure-Regularized Night-Time Self-Supervised Monocular Depth Estimation for Outdoor Scenes

Self-Supervised Monocular Depth Estimation via Binocular Geometric Correlation Learning

Attention-Based Monocular Depth Estimation Considering Global and Local Information in Remote Sensing Images

Weakly-Supervised Monocular Depth Estimationwith Resolution-Mismatched Data

On Robust Cross-View Consistency in Self-Supervised Monocular Depth Estimation

Structure-Attentioned Memory Network for Monocular Depth Estimation

Color and Geometric Contrastive Learning Based Intra-Frame Supervision for Self-Supervised Monocular Depth Estimation

Monocular Depth Estimation with Joint Attention Feature Distillation and Wavelet-Based Loss Function

Learning Monocular Depth in Dynamic Environment via Context-aware Temporal Attention

Neural Window Fully-connected CRFs for Monocular Depth Estimation

Self-Supervised Monocular Depth Estimation With Multiscale Perception

Self-Supervised Monocular Depth Estimation Based on High-Order Spatial Interactions

Learning Occlusion-Aware Coarse-to-Fine Depth Map for Self-supervised Monocular Depth Estimation