Abstract:To estimate depth maps from monocular videos in a self-supervised way, existing methods simultaneously predict the pose changes between adjacent frames and the depth maps of each frame, and then reconstruct the forward or backward frames using them, thereby casting depth estimation as a frame reconstruction problem. The corresponding reconstruction loss, which serves as a key supervision signal for training the whole network, can adversely affect the depth estimation accuracy if it is not properly established. In this paper, we propose a novel self-supervised monocular depth estimation method from videos via adaptive reconstruction constraints, i.e., designing the loss functions by establishing more accurate reconstruction constraints. Specifically, we first propose a pose-adaptive reconstruction loss to adaptively select the optimal pose parameterizations that yield the minimum reconstruction errors, reducing the impact of inaccurate posture on frame reconstruction. Then, we propose a region-sensitive reconstruction loss that fully utilizes the pretrained image reconstruction model to adaptively identify the poorly reconstructed regions and characterize the deviation of these regions on feature space. Finally, we additionally construct a multi-frame depth estimation network and design a reconstruction-guided bidirectional distillation loss to adaptively adjust the direction of distillation between networks of multi-frame and monocular depth estimation based on their current reconstruction quality, which encourages them to learn from each other and benefits the core task of monocular depth estimation. With our proposed losses, we achieve superior performance in comparison with state-of-the-art methods on benchmark datasets.

Towards Loss Balance and Consistent Model in Self-supervised Monocular Depth Estimation

Monocular Depth Estimation Based on Unsupervised Learning

Self-Supervised Monocular Depth Estimation with Multi-constraints

Spatiotemporally Enhanced Photometric Loss for Self-Supervised Monocular Depth Estimation.

Self-supervised monocular depth estimation via joint attention and intelligent mask loss

Unsupervised Monocular Depth and Pose Estimation Using Multiple Masks Based on Photometric and Geometric Consistency

Self-supervised Monocular Depth Estimation with Multi-Scale Structure Similarity Loss

Self-Supervised Monocular Depth Estimation with Binary Mask and Lightweight Network

Self-Supervised Monocular Depth Estimation Via Effective Local Consistency and Multi-scale Attention

Self-Supervised Learning of Monocular Depth Estimation Based on Progressive Strategy.

Unsupervised Monocular Estimation of Depth and Visual Odometry uUsing Attention and Depth-Pose Consistency Loss

Self-supervised Monocular Depth Estimation with Self-Distillation and Dense Skip Connection

Adv-Depth: Self-Supervised Monocular Depth Estimation with an Adversarial Loss.

Self-Supervised Monocular Depth Estimation Based on High-Order Spatial Interactions

From Coarse to Fine: A Monocular Depth Estimation Model Based on Left-Right Consistency.

Self-Supervised Monocular Depth Estimation from Videos Via Adaptive Reconstruction Constraints

A Self-Supervised Monocular Depth Estimation Method Based on High Resolution Convolutional Neural Network

Monocular Depth Estimation With Affinity, Vertical Pooling, And Label Enhancement

Self-Supervised Monocular Depth Learning in Low-Texture Areas

Toward Better SSIM Loss for Unsupervised Monocular Depth Estimation

Lightweight Self-Supervised Monocular Depth Estimation Through CNN and Transformer Integration