Abstract:Stereo matching is the key step in estimating depth from two or more images. Recently, some tree-based non-local stereo matching methods have been proposed, which achieved state-of-the-art performance. The algorithms employed some tree structures to aggregate cost and thus improved the performance and reduced the coputation load of the stereo matching. However, the computational complexity of these tree-based algorithms is still high because they search over the entire disparity range. In addition, the extreme greediness of the minimum spanning tree (MST) causes the poor performance in large areas with similar colors but varying disparities. In this paper, we propose an efficient stereo matching method using a hierarchical disparity prediction (HDP) framework to dramatically reduce the disparity search range so as to speed up the tree-based non-local stereo methods. Our disparity prediction scheme works on a graph pyramid derived from an image whose disparity to be estimated. We utilize the disparity of a upper graph to predict a small disparity range for the lower graph. Some independent disparity trees (DT) are generated to form a disparity prediction forest (HDPF) over which the cost aggregation is made. When combined with the state-of-the-art tree-based methods, our scheme not only dramatically speeds up the original methods but also improves their performance by alleviating the second drawback of the tree-based methods. This is partially because our DTs overcome the extreme greediness of the MST. Extensive experimental results on some benchmark datasets demonstrate the effectiveness and efficiency of our framework. For example, the segment-tree based stereo matching becomes about 25.57 times faster and 2.2% more accurate over the Middlebury 2006 full-size dataset.

Loop-tree Method for Cost Aggregation in Stereo Matching

Oriented-linear-tree based cost aggregation for stereo matching

Linear Time Non-Local Cost Aggregation on Complementary Spatial Tree Structures

3D Cost Aggregation with Multiple Minimum Spanning Trees for Stereo Matching.

Spatial‐Tree Filter for Cost Aggregation in Stereo Matching

Adaptive stereo matching via loop-erased random walk

Edge-preserving Guided Filtering Based Cost Aggregation for Stereo Matching.

Hybrid cost aggregation for dense stereo matching

Fast Non-local Stereo Matching based on Hierarchical Disparity Prediction

Hierarchical and Multi-Level Cost Aggregation for Stereo Matching.

Stereo Matching by Adaptive Weighting Selection Based Cost Aggregation

Cross-Scale Cost Aggregation for Stereo Matching

Stereo Matching with Space-Constrained Cost Aggregation and Segmentation-Based Disparity Refinement

Hybrid stereo matching by dynamic programming with enhanced cost entry for real-time depth generation

Generalized Stereo Matching Method Based on Iterative Optimization of Hierarchical Graph Structure Consistency Cost for Urban 3D Reconstruction

A New Stereo Matching Method with Combination of Cross-Based Aggregation and Hierarchical Belief Propagation

Block Based Dense Stereo Matching Using Adaptive Cost Aggregation and Limited Disparity Estimation

Local Stereo Matching with Improved Matching Cost and Disparity Refinement.

Binary Stereo Matching

LightStereo: Channel Boost Is All Your Need for Efficient 2D Cost Aggregation

A fast line segment based dense stereo algorithm using tree dynamic programming