Abstract:Stereo matching depth estimation based on rectified image pairs is of great importance to many computer vision tasks such as vehicle navigation and autonomous driving. Confidence measures are typically used to refine stereo matching results, which provides robustness and efficiency for disparity estimation. However, previous learning-based confidence methods for stereo matching usually use the middle results or composition as a post-processing step to refine the stereo matching results. This cannot be optimized end-to-end and the performance is limited by the quality of the tri-modal output. To handle this issue, in this paper, we pursue an end-to-end hierarchical architecture and propose a differentiable confidence propagation (DCP) model of a cost aggregation network for stereo matching. The DCP model is integrated into an end-to-end neural network hierarchical architecture to guide matching cost volume aggregation. More specifically, to better represent the similarity of left and right feature maps, we extract unary context feature maps with an effective attention mechanism for matching cost construction. Moreover, we aggregate the cost volume with the multiple stacked DCP cost aggregation (DCPCA) networks to generate a more reliable and finer cost volume. This network suppresses multi-level disparity maps. Each output disparity is supervised with different training weights to learn in a coarse-to-fine way. Our method outperforms previous methods on the Sceneflow dataset by achieving the $0.6735px$ EPE error, achieving 1.53% D1-all metric of Non-occluded pixels regions and 0.72% Non-occluded pixels of $5px$ metric on KITTI 2015 and 2012 dataset. Extensive experiments carried out on the KITTI Stereo benchmarks demonstrate that our DCPCA-Net can significantly minimize the trade-off between accuracy and efficiency for stereo matching.

Novel Belief Propagation Algorithm for Stereo Matching with a Robust Cost Computation

Toward a Real-Time Belief Propagation Stereo Reconstruction for Computers, Robots, and Beyond

A stereo matching algorithm based on selective belief propagation

A Belief Propagation Algorithm for Stereo Matching

Stereo Matching with Semi-limited Belief Propagation

Stereo matching using belief propagation and local edge construction-based cost aggregation

Edge-preserving Guided Filtering Based Cost Aggregation for Stereo Matching.

Stereo Matching with Cost Volume based Sparse Disparity Propagation

A novel method of stereo matching based on hierarchical belief-propagation

A New Stereo Matching Method with Combination of Cross-Based Aggregation and Hierarchical Belief Propagation

Stereo Matching Algorithm Based on Fast-Converging Belief Propagation

Stereo Matching Using Belief Propagation with Spatiotemporal Consistency

Parallel Stereo Matching Algorithm Base on Belief Propagation

Belief propagation with local edge detection-based cost aggregation for stereo matching

Belief propagation on Riemannian manifold for stereo matching

Stereo Matching Using Belief Propagation

Improved Belief Propagation Based on RGB Vector Measure for Stereo Matching.

Better Stereo Matching from Simple Yet Effective Wrangling of Deep Features

Research and Application of Speed-up Techniques for Belief Propagation Stereo

Deep Confidence Propagation Stereo Network

Stereo Matching with Space-Constrained Cost Aggregation and Segmentation-Based Disparity Refinement