Abstract:<p>Human visual system relies on both monocular focusness cues and binocular stereo cues to gain effective 3D perception. Correspondingly, depth from focus/defocus (DfF/DfD) and stereo matching are two most studied passive depth sensing schemes, which are traditionally solved in separate tracks. However, the two techniques are essentially complementary: the monocular cue from DfF/DfD can robustly handle repetitive textures and occlusion that are problematic for stereo matching whereas the binocular cue from stereo matching is insensitive to defocus blurs and can resolve large depth range. In this paper, we emulate human perception and present unified learning-based techniques to conduct hybrid DfF/DfD and stereo matching. We first construct a comprehensive focal stack dataset synthesized by depth-guided light field rendering. Next, we propose different network architectures to suit various inputs, including focal stack, stereo image pair, binocular focal stack, a focus-defocus image pair and defocus-stereo image triplet. We also exploit different connection methods between the separate networks for integrating them into an optimized solution to produce high fidelity disparity maps. For experiment, we further explore different hardware setup to capture both monocular and binocular depth cues. Results show that our new learning-based hybrid techniques can significantly improve accuracy and robustness in depth estimation.</p>

Depth Estimation Method Based on Monocular Bifocal Imaging and SIFT Feature Matching

Research progress of depth detection in vision measurement: A novel project of bifocal imaging system for 3D measurement

A Fused Estimation Method of Depth Based on Depth from Stereo and Depth from Focus

Depth Estimation Based on Adaptive Support Weight and SIFT for Multi-Lenslet Cameras

3D reconstruction from bifocus imaging

The Depth Estimate of Interesting Points from Monocular Vision

Depth Extraction Method Based on Multi-view Stereo Matching

An Automatic Measurement Method for Absolute Depth of Objects in Two Monocular Images Based on SIFT Feature

Depth Measurement of the Object Based on the Corresponding Points Matching

Relative Depth Estimation With An Uncalibrated Camera For Image Refocus

Depth Measurement Based on Bifocus Imaging

Research on Monocular Depth Sensing Method Based on Liquid Zoom Imaging

Depth Estimation Method for Monocular Camera Defocus Images in Microscopic Scenes

Analysis of the Monocular Stereo System Based on Bifocal Imaging

Binocular Depth Estimation Based on Diffractive Optical Elements and the Semiglobal Matching Algorithm

Depth Estimation Via Light Field Camera with a Hybrid Stereo Matching Method

A Monocular Stereo Vision Algorithm Based on Bifocal Imaging

Depth‐map Generation for Multi‐view Autostereoscopic 3‐D Displays Based on the SIFT Algorithm Constrained by Boundary

Deep eyes: Joint depth inference using monocular and binocular cues

Size-to-depth: A New Perspective for Single Image Depth Estimation

Depth estimation of monocular thermal images based on spatial pyramid matching