Abstract:Self-supervised monocular depth estimation, aiming to learn scene depths from single images in a self-supervised manner, has received much attention recently. In spite of recent efforts in this field, how to learn accurate scene depths and alleviate the negative influence of occlusions for self-supervised depth estimation, still remains an open problem. Addressing this problem, we firstly empirically analyze the effects of both the continuous and discrete depth constraints which are widely used in the training process of many existing works. Then inspired by the above empirical analysis, we propose a novel network to learn an Occlusion-aware Coarse-to-Fine Depth map for self-supervised monocular depth estimation, called OCFD-Net. Given an arbitrary training set of stereo image pairs, the proposed OCFD-Net does not only employ a discrete depth constraint for learning a coarse-level depth map, but also employ a continuous depth constraint for learning a scene depth residual, resulting in a fine-level depth map. In addition, an occlusion-aware module is designed under the proposed OCFD-Net, which is able to improve the capability of the learnt fine-level depth map for handling occlusions. Experimental results on KITTI demonstrate that the proposed method outperforms the comparative state-of-the-art methods under seven commonly used metrics in most cases. In addition, experimental results on Make3D demonstrate the effectiveness of the proposed method in terms of the cross-dataset generalization ability under four commonly used metrics. The code is available at <a class="link-external link-https" href="https://github.com/ZM-Zhou/OCFD-Net_pytorch" rel="external noopener nofollow">this https URL</a>.

Self-supervised coarse-to-fine monocular depth estimation using a lightweight attention module

MDSNet: self-supervised monocular depth estimation for video sequences using self-attention and threshold mask

Self-supervised Monocular Depth Estimation with Coordinate Attention

Super-Resolution for Monocular Depth Estimation with Multi-Scale Sub-Pixel Convolutions and a Smoothness Constraint.

Self-supervised monocular depth estimation via joint attention and intelligent mask loss

A Cnn-Based Depth Estimation Approach With Multi-Scale Sub-Pixel Convolutions And A Smoothness Constraint

Learning Occlusion-Aware Coarse-to-Fine Depth Map for Self-supervised Monocular Depth Estimation

Self-Supervised Monocular Depth Estimation with Binary Mask and Lightweight Network

Self-Supervised Learning of Monocular Depth Estimation Based on Progressive Strategy.

Self-Supervised Monocular Depth Estimation Based on Channel Attention

A Self-Supervised Monocular Depth Estimation Method Based on High Resolution Convolutional Neural Network

Self-supervised monocular depth estimation based on image texture detail enhancement

Self-supervised Monocular Depth Estimation with Large Kernel Attention

Unsupervised Monocular Estimation of Depth and Visual Odometry uUsing Attention and Depth-Pose Consistency Loss

Monocular Depth Estimation With Affinity, Vertical Pooling, And Label Enhancement

Deeper into Self-Supervised Monocular Indoor Depth Estimation

Self-Supervised Monocular Depth Estimation Via Effective Local Consistency and Multi-scale Attention

Channel-Wise Attention-Based Network for Self-Supervised Monocular Depth Estimation

LAM-Depth: Laplace-Attention Module-Based Self-Supervised Monocular Depth Estimation

CCDepth: A Lightweight Self-supervised Depth Estimation Network with Enhanced Interpretability

Self-Supervised Monocular Depth Learning in Low-Texture Areas