Abstract:Estimating dense correspondence or depth information from a pair of stereoscopic images is a fundamental problem in computer vision, which finds a range of important applications. Despite intensive past research efforts in this topic, it still remains challenging to recover the depth information both reliably and efficiently, especially when the input images contain weakly textured regions or are captured under uncontrolled, real-life conditions. Striking a desired balance between computational efficiency and estimation quality, a hybrid minimum spanning tree-based stereo matching method is proposed in this paper. Our method performs efficient nonlocal cost aggregation at pixel-level and region-level, and then adaptively fuses the resulting costs together to leverage their respective strength in handling large textureless regions and fine depth discontinuities. Experiments on the standard Middlebury stereo benchmark show that the proposed stereo method outperforms all prior local and nonlocal aggregation-based methods, achieving particularly noticeable improvements for low texture regions. To further demonstrate the effectiveness of the proposed stereo method, also motivated by the increasing desire to generate expressive depth-induced photo effects, this paper is tasked next to address the emerging application of interactive depth-of-field rendering given a real-world stereo image pair. To this end, we propose an accurate thinlens model for synthetic depth-of-field rendering, which considers the user-stroke placement and camera-specific parameters and performs the pixel-adapted Gaussian blurring in a principled way. Taking similar to 1.5 s to process a pair of 640 x 360 images in the off-line step, our system named Scribble2focus allows users to interactively select in-focus regions by simple strokes using the touch screen and returns the synthetically refocused images instantly to the user.

Refocusing Images Captured from a Stereoscopic Camera

Three Dimensional Surface Reconstruction Based on Light Field Imaging

Three Dimensional Reconstruction Using a Lenslet Light Field Camera

Multi-image-distance Imaging System for Extending Depth-of-field

Refocusing Images and Videos with a Conventional Compact Camera

Computer simulation for digital refocusing imager based on light field photography

Improved Depth Estimation with the Light Field Camera

Simulation Of Imaging And Refocusing For Light Field Photography

Relative Depth Estimation With An Uncalibrated Camera For Image Refocus

Light field camera all-in-focus image acquisition based on angular information

Depth Sensing with Focus and Exposure Adaptation.

Scribble2focus: An interactive photo refocusing system based on mobile stereo imaging

Depth-Based Computational Photography

Extended Depth-Of-Field Via Focus Stacking And Graph Cuts

A Novel Depth Recovery Approach from Multi-View Stereo Based Focusing

Depth Extraction from a Light Field Camera Using Weighted Median Filtering.

Depth Fused from Intensity Range and Blur Estimation for Light-Field Cameras

High-resolution Light Field Reconstruction Using a Hybrid Imaging System

Depth Estimation Algorithm for Light Field Data by Epipolar Image Analysis and Region Interpolation

Efficient Hybrid Tree-Based Stereo Matching With Applications to Postcapture Image Refocusing.

Depth Estimation Via Light Field Camera with a Hybrid Stereo Matching Method