Abstract:Self-supervised monocular depth estimation, aiming to learn scene depths from single images in a self-supervised manner, has received much attention recently. In spite of recent efforts in this field, how to learn accurate scene depths and alleviate the negative influence of occlusions for self-supervised depth estimation, still remains an open problem. Addressing this problem, we firstly empirically analyze the effects of both the continuous and discrete depth constraints which are widely used in the training process of many existing works. Then inspired by the above empirical analysis, we propose a novel network to learn an Occlusion-aware Coarse-to-Fine Depth map for self-supervised monocular depth estimation, called OCFD-Net. Given an arbitrary training set of stereo image pairs, the proposed OCFD-Net does not only employ a discrete depth constraint for learning a coarse-level depth map, but also employ a continuous depth constraint for learning a scene depth residual, resulting in a fine-level depth map. In addition, an occlusion-aware module is designed under the proposed OCFD-Net, which is able to improve the capability of the learnt fine-level depth map for handling occlusions. Experimental results on KITTI demonstrate that the proposed method outperforms the comparative state-of-the-art methods under seven commonly used metrics in most cases. In addition, experimental results on Make3D demonstrate the effectiveness of the proposed method in terms of the cross-dataset generalization ability under four commonly used metrics. The code is available at <a class="link-external link-https" href="https://github.com/ZM-Zhou/OCFD-Net_pytorch" rel="external noopener nofollow">this https URL</a>.

An Occlusion and Noise-aware Stereo Framework Based on Light Field Imaging for Robust Disparity Estimation

Calibration-free Deep Optics for Depth Estimation with Precise Simulation

Reliable Fusion of ToF and Stereo Data Based on Joint Depth Filter

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

Anti-Noise Light Field Depth Estimation Using Inline Occlusion Handling

Toward Real-World Light Field Depth Estimation: A Noise-Aware Paradigm Using Multi-Stereo Disparity Integration

Occlusion-Model Guided Antiocclusion Depth Estimation in Light Field

OccCasNet: Occlusion-aware Cascade Cost Volume for Light Field Depth Estimation

Depth Estimation Algorithm for Light Field Data by Epipolar Image Analysis and Region Interpolation

Baseline-Adaptive Light Field Depth Estimation Based on Stereo Matching

Disparity Estimation for Focused Light Field Camera Using Cost Aggregation in Micro-Images

Unsupervised Dense Light Field Reconstruction with Occlusion Awareness

Epipolar Focus Spectrum: A Novel Light Field Representation and Application in Dense-view Reconstruction

Robust depth estimation for multi-occlusion in light-field images.

LF-DWNet: Robust Depth Estimation Network for Light Field with Disparity Warping

Light Field Depth Estimation Exploiting Linear Structure in EPI

Learning Occlusion-Aware Coarse-to-Fine Depth Map for Self-supervised Monocular Depth Estimation

Depth Estimation for Light-Field Images Using Stereo Matching and Convolutional Neural Networks

Depth Map Estimation with 4D Light Fields Using Confocal Stereo

Joint Image Denoising and Disparity Estimation Via Stereo Structure PCA and Noise-Tolerant Cost

Iterative Occlusion-Aware Light Field Depth Estimation using 4D Geometrical Cues