Abstract:Estimating dense correspondence or depth information from a pair of stereoscopic images is a fundamental problem in computer vision, which finds a range of important applications. Despite intensive past research efforts in this topic, it still remains challenging to recover the depth information both reliably and efficiently, especially when the input images contain weakly textured regions or are captured under uncontrolled, real-life conditions. Striking a desired balance between computational efficiency and estimation quality, a hybrid minimum spanning tree-based stereo matching method is proposed in this paper. Our method performs efficient nonlocal cost aggregation at pixel-level and region-level, and then adaptively fuses the resulting costs together to leverage their respective strength in handling large textureless regions and fine depth discontinuities. Experiments on the standard Middlebury stereo benchmark show that the proposed stereo method outperforms all prior local and nonlocal aggregation-based methods, achieving particularly noticeable improvements for low texture regions. To further demonstrate the effectiveness of the proposed stereo method, also motivated by the increasing desire to generate expressive depth-induced photo effects, this paper is tasked next to address the emerging application of interactive depth-of-field rendering given a real-world stereo image pair. To this end, we propose an accurate thinlens model for synthetic depth-of-field rendering, which considers the user-stroke placement and camera-specific parameters and performs the pixel-adapted Gaussian blurring in a principled way. Taking similar to 1.5 s to process a pair of 640 x 360 images in the off-line step, our system named Scribble2focus allows users to interactively select in-focus regions by simple strokes using the touch screen and returns the synthetically refocused images instantly to the user.

A Method Combining Active Stereo with Global Matching Algorithm for Accurate Depth Extraction.

Reliable Fusion of ToF and Stereo Data Based on Joint Depth Filter

Depth Extraction Method Based on Multi-view Stereo Matching

High-Quality Depth Recovery Via Interactive Multi-view Stereo

Hybrid stereo matching by dynamic programming with enhanced cost entry for real-time depth generation

K-nearest Neighborhood Based Integration of Time-of-flight Cameras and Passive Stereo for High-Accuracy Depth Maps.

Sparse LIDAR Measurement Fusion with Joint Updating Cost for Fast Stereo Matching

High quality depth maps from stereo matching and ToF camera.

Accurate Real-Time Stereo Correspondence Using Intra- and Inter-Scanline Optimization

Depth Acquisition with the Combination of Structured Light and Deep Learning Stereo Matching.

K-nearestneighborhood Basedintegrationoftime-of-flight Camerasandpassivestereoforhigh-Accuracydepthmaps ∗

Binocular Depth Estimation Based on Diffractive Optical Elements and the Semiglobal Matching Algorithm

Real-Time Accurate Stereo Matching Using Modified Two-Pass Aggregation and Winner-Take-All Guided Dynamic Programming

Multiple Candidates and Multiple Constraints Based Accurate Depth Estimation for Multi-View Stereo

Efficient Hybrid Tree-Based Stereo Matching With Applications to Postcapture Image Refocusing.

Global Stereo Matching Algorithm Based on Disparity Range Estimation

Stereo Matching Based on Two Cameras and One 3D Image Sensor.

Hybrid Tree Guided Patch Matching

Adaptive Support-Weight Stereo-Matching Approach with Two Disparity Refinement Steps

A depth map estimation approach for trinocular stereo

Global Depth Refinement Based on Patches