Abstract:We present a stereo matching approach referred to as HLocalExp-CM by exploiting the hierarchical local contextual information and a confidence map based on a new grid structure. The proposed approach preserves fine depth edges and extracts accurate disparities in weak texture, textureless, and repeated texture regions. The proposed approach adopts a two-stage optimization strategy. In the framework of first stage, a multiresolution cost aggregation is minimized to reduce the search space of the disparity plane of each pixel. The second stage iteratively optimizes the confidence map and a global energy function to progressively improve the disparity accuracy for each pixel. The confidence map is estimated through classifying the pixels into distinctive and ambiguous ones by computing the decreasing rate of the multiresolution cost aggregation and then performs a spatial propagation and plane refinement for the update of the disparity of each pixel, thereby successfully eliminating the ambiguity of nondistinctive pixels. The global energy function based on a pairwise Markov random field uses cross-scale cost aggregation for taking advantage of context information of objects in different scenarios on local grid regions, which is different from the deep learning technique uses convolution layers extracting the context information. The proposed approach is evaluated on Middlebury benchmark V3, and is ranked first based on "bad 2.0 all metric," a widely used criterion for the evaluation of stereo images, while the eighth place on "bad 2.0 nonocc metric" (recorded on July 24, 2021). (C) 2022 SPIE and IS&T

Ambiguous Region Matching and Boundary Pixel Optimization for Stereo Computation

Segment-based Continuous Stereo Matching

Efficient Binocular Stereo Matching Based on Sad and Improved Census Transformation

Space-temporal stereo matching for dynamic scene

Color Image-Guided Boundary-Inconsistent Region Refinement for Stereo Matching

A New Stereo Matching Method with Combination of Cross-Based Aggregation and Hierarchical Belief Propagation

Stereo Matching with Space-Constrained Cost Aggregation and Segmentation-Based Disparity Refinement

An Efficient Stereo Disparity Estimation Method Based on Region Information

Local Expansion Moves for Stereo Matching Based on Random Sample Consensus Confidence

Robust Region-Wise Colour Correction Method for Stereo Matching

PM-PM: PatchMatch with Potts Model for Object Segmentation and Stereo Matching.

Object segmentation using stereo images

Stereo Matching Using Local Plane Fitting in Confidence-Based Support Window.

Stereo Matching Via Disparity Estimation And Surface Modeling

Superpixel Alpha-Expansion and Normal Adjustment for Stereo Matching.

Robust stereo matching with surface normal prediction.

Segment-Based Disparity Refinement With Occlusion Handling for Stereo Matching

HLocalExp-CM: confidence map by hierarchical local expansion moves for accurate stereo matching

Local PatchMatch Based on Superpixel Cut for Efficient High-resolution Stereo Matching

Edge-Preserving Stereo Matching Using Minimum Spanning Tree

Accurate Real-Time Stereo Correspondence Using Intra- and Inter-Scanline Optimization