Abstract:Stereo matching depth estimation based on rectified image pairs is of great importance to many computer vision tasks such as vehicle navigation and autonomous driving. Confidence measures are typically used to refine stereo matching results, which provides robustness and efficiency for disparity estimation. However, previous learning-based confidence methods for stereo matching usually use the middle results or composition as a post-processing step to refine the stereo matching results. This cannot be optimized end-to-end and the performance is limited by the quality of the tri-modal output. To handle this issue, in this paper, we pursue an end-to-end hierarchical architecture and propose a differentiable confidence propagation (DCP) model of a cost aggregation network for stereo matching. The DCP model is integrated into an end-to-end neural network hierarchical architecture to guide matching cost volume aggregation. More specifically, to better represent the similarity of left and right feature maps, we extract unary context feature maps with an effective attention mechanism for matching cost construction. Moreover, we aggregate the cost volume with the multiple stacked DCP cost aggregation (DCPCA) networks to generate a more reliable and finer cost volume. This network suppresses multi-level disparity maps. Each output disparity is supervised with different training weights to learn in a coarse-to-fine way. Our method outperforms previous methods on the Sceneflow dataset by achieving the $0.6735px$ EPE error, achieving 1.53% D1-all metric of Non-occluded pixels regions and 0.72% Non-occluded pixels of $5px$ metric on KITTI 2015 and 2012 dataset. Extensive experiments carried out on the KITTI Stereo benchmarks demonstrate that our DCPCA-Net can significantly minimize the trade-off between accuracy and efficiency for stereo matching.

Deep spatial and discriminative feature enhancement network for stereo matching

Deep Contextual Structure and Semantic Feature Enhancement Stereo Network

Deep Stereo Matching with Superpixel Based Feature and Cost.

Attention-guided aggregation stereo matching network

Deep Stereo Matching with Explicit Cost Aggregation Sub-Architecture

Deep Stereo Matching With Hysteresis Attention and Supervised Cost Volume Construction

Deep Stereo Network with Cross-Correlation Volume Construction and Least Square Aggregation

Deep Stereo Network with MRF-Based Cost Aggregation

Better Stereo Matching from Simple Yet Effective Wrangling of Deep Features

Deeply-fused Attentive Network for Stereo Matching

Local Similarity Pattern and Cost Self-Reassembling for Deep Stereo Matching Networks

GA-Stereo: A Real-Time Stereo Network Based on the Gradient Flow Shunting Strategy and the Atrous Pyramid Network

Self-adaptive Multi-scale Aggregation Network for Stereo Matching.

Deep Progressive Fusion Stereo Network

Cascaded Feature Interaction Network for Stereo Matching

Deep Confidence Propagation Stereo Network

A Fast Stereo Matching Network with Multi-Cross Attention

Multi-Dimensional Cooperative Network for Stereo Matching

AP-Net: Attention-fused Volume and Progressive Aggregation for Accurate Stereo Matching

TemporalStereo: Efficient Spatial-Temporal Stereo Matching Network

Superpixel Guided Network for Three-Dimensional Stereo Matching