Abstract:A novel patch-based correspondence model is presented in this paper. Many segment-based correspondence approaches have been proposed in recent years. Untextured pixels and boundaries of discontinuities are imposed with hard constraints by the discontinuity assumption that large disparity variation only happens at the boundaries of segments in the above approaches. Significant improvements on performance of untextured and discontinuity area have been reported. But, the performance near occlusion is not satisfactory because a segmented region in one image may be only partially visible in the other one. To solve this problem, we utilize the observation that the shared edge of a visible area and an occluded area corresponds to the discontinuity in the other image. So, the proposed model conducts color segmentation on both images first and then a segment in one image is further cut into smaller patches corresponding to the boundaries of segments in the other when it is assigned with a disparity. Different visibility of patches in one segment is allowed. The uniqueness constraint in a segment level is used to compute the occlusions. An energy minimization framework using graph-cuts is proposed to find a global optimal configuration including both disparities and occlusions. Besides, some measurements are taken to make our segment-based algorithm suffer less from violation of the discontinuity assumption. Experimental results have shown superior performance of the proposed approach, especially on occlusions, untextured areas, and near discontinuities.

A Symmetric Patch-Based Correspondence Model for Occlusion Handling.

Stereo Correspondence with Occlusion Handling in a Symmetric Patch-Based Graph-Cuts Model.

Symmetric Pixel-Group Based Stereo Matching for Occlusion Handling

Local Spatial Continuity Steered Sparse Representation for Occluded Face Recognition

Segment-based Continuous Stereo Matching

PM-PM: PatchMatch with Potts Model for Object Segmentation and Stereo Matching.

Dense Stereo Correspondence with Contrast Context Histogram, Segmentation-Based Two-Pass Aggregation and Occlusion Handling

Continuous Symmetric Stereo with Adaptive Outlier Handling

Correspondence-free Stereo Vision: Extension from Planar Scene Case to Polyhedral Scene Case

Coordinating Multiple Disparity Proposals for Stereo Computation.

SymmNet: A Symmetric Convolutional Neural Network for Occlusion Detection

Superpixel-based Graph Cuts for Accurate Stereo Matching

Occlusion Aware Stereo Matching Via Cooperative Unsupervised Learning

Unsupervised Occlusion-Aware Stereo Matching with Directed Disparity Smoothing

Segment-Based Disparity Refinement With Occlusion Handling for Stereo Matching

Symmetry Weight-sharing for Patch-based Stereo Matching

A DAISY Descriptor Based Multi-View Stereo Method for Large-Scale Scenes.

Correspondence-Free Stereo Vision For The Case Of Arbitrarily-Positioned Cameras

Symmetric Segment-Based Stereo Matching Of Motion Blurred Images With Illumination Variations

A Novel Segmentation Method of Moving Occlusion Targets in Traffic Applications Based on Binocular Vision and Background Subtraction

Who Blocks Who: Simultaneous Segmentation of Occluded Objects