Abstract:Supervised monocular depth estimation methods based on learning have shown promising results compared with the traditional methods. However, these methods require a large number of high-quality corresponding ground truth depth data as supervision labels. Due to the limitation of acquisition equipment, it is expensive and impractical to record ground truth depth for different scenes. Compared to supervised methods, the self-supervised monocular depth estimation method without using ground truth depth is a promising research direction, but self-supervised depth estimation from a single image is geometrically ambiguous and suboptimal. In this paper, we propose a novel semi-supervised monocular stereo matching method based on existing approaches to improve the accuracy of depth estimation. This idea is inspired by the experimental results of the paper that the depth estimation accuracy of a stereo pair as input is better than that of a monocular view as input in the same self-supervised network model. Therefore, we decompose the monocular depth estimation problem into two sub-problems, a right view synthesized process followed by a semi-supervised stereo matching process. In order to improve the accuracy of the synthetic right view, we innovate beyond the existing view synthesis method Deep3D by adding a left-right consistency constraint and a smoothness constraint. To reduce the error caused by the reconstructed right view, we propose a semi-supervised stereo matching model that makes use of disparity maps generated by a self-supervised stereo matching model as the supervision cues and joint self-supervised cues to optimize the stereo matching network. In the test, the two networks are able to predict the depth map directly from a single image by pipeline connecting. Both procedures not only obey geometric principles, but also improve estimation accuracy. Test results on the KITTI dataset show that this method is superior to the current mainstream monocular self-supervised depth estimation methods under the same condition.

Semi-Stereo: A Universal Stereo Matching Framework for Imperfect Data Via Semi-supervised Learning

A unified and efficient semi-supervised learning framework for stereo matching

Stereo Anything: Unifying Stereo Matching with Large-Scale Mixed Data

Stereo Matching by Self-supervision of Multiscopic Vision.

Semi-synthesis: A Fast Way to Produce Effective Datasets for Stereo Matching

A Semi-Supervised Monocular Stereo Matching Method

Stereo matching from monocular images using feature consistency

Self-Supervised Learning for Stereo Matching with Self-Improving Ability

SemStereo: Semantic-Constrained Stereo Matching Network for Remote Sensing

Semi-supervised Deep Multi-view Stereo

AdaStereo: A Simple and Efficient Approach for Adaptive Stereo Matching

Visually Imbalanced Stereo Matching

FINE-TUNING DEEP LEARNING MODELS FOR STEREO MATCHING USING RESULTS FROM SEMI-GLOBAL MATCHING

Improving Stereo Matching by Incorporating Geometry Prior into Convnet

Bidirectional Semi-supervised Dual-branch CNN for Robust 3D Reconstruction of Stereo Endoscopic Images via Adaptive Cross and Parallel Supervisions

Unsupervised Stereo Matching With Occlusion-Aware Loss

Superpixel Guided Network for Three-Dimensional Stereo Matching

Rethinking the Key Factors for the Generalization of Remote Sensing Stereo Matching Networks

Patchmatch Stereo++: Patchmatch Binocular Stereo with Continuous Disparity Optimization

Semi-Supervised Stereo-Based 3D Object Detection Via Cross-View Consensus

OpenStereo: A Comprehensive Benchmark for Stereo Matching and Strong Baseline