Abstract:Imposing smoothness priors is a key idea of the top-ranked global stereo models. Recent progresses demonstrated the power of second order priors which are usually defined by either explicitly considering three-pixel neighborhoods, or implicitly using a so-called 3D-label for each pixel. In contrast to the traditional first-order priors which only prefer fronto-parallel surfaces, second-order priors encourage arbitrary collinear structures. However, we still can find defective regions in matching results even under such powerful priors, e. g., large textureless regions. One reason is that most of the stereo models are non-convex, where pixel-wise smoothness priors, i.e., local constraints, are too flexible to prevent the solution from trapping in bad local minimums. On the other hand, long-range spatial constraints, especially the segment-based priors, have advantages on this problem. However, segment-based priors are too rigid to handle curved surfaces. We present a mixture model to combine the benefits of these two kinds of priors, whose energy function consists of two terms 1) a Laplacian operator on the disparity map which imposes pixel-wise second-order smoothness; 2) a segment-wise matching cost as a function of quadratic surface, which encourages "as-rigid-as-possible" smoothness. To effectively solve the problem, we introduce an intermediate term to decouple the two subenergies, which enables an alternated optimization algorithm that is about an order of magnitude faster than PatchMatch [1]. Our approach is one of the top ranked models on the Middlebury benchmark at sub-pixel accuracy.

Stereo Matching by Using Adaptive Smoothness Term

Space-temporal stereo matching for dynamic scene

Segment-based Continuous Stereo Matching

A New Fuzzy Smoothing Term Model for Stereo Matching.

Efficient Binocular Stereo Matching Based on Sad and Improved Census Transformation

Dynamic Limited-Search Matching Algorithm Based on Geometric Properties of Stereo Imaging

Constrained Smoothness Cost in Markov Random Field Based Stereo Matching

As-Rigid-As-Possible Stereo Under Second Order Smoothness Priors

An Improved Adaptive Window Stereo Matching Algorithm

Stereo matching method based on high-precision occlusion-recovering and discontinuity-preserving

A Fast Local Stereo Matching Insensitive to Illumination Conditions

Temporally Consistent Stereo Matching

Robust Region-Wise Colour Correction Method for Stereo Matching

Mutual information based non-parametric transform stereo matching algorithm

Intrinsic Color Correction for Stereo Matching.

Continuous Symmetric Stereo with Adaptive Outlier Handling

Edge-Preserving Stereo Matching Using Minimum Spanning Tree

Adaptive Disparity Computation Using Local and Non-Local Cost Aggregations

Robust stereo matching with surface normal prediction.

Efficient Large Scale Stereo Matching Based on Cross-Scale.

Stereo Matching Via Disparity Estimation And Surface Modeling