Abstract:Stereo matching depth estimation based on rectified image pairs is of great importance to many computer vision tasks such as vehicle navigation and autonomous driving. Confidence measures are typically used to refine stereo matching results, which provides robustness and efficiency for disparity estimation. However, previous learning-based confidence methods for stereo matching usually use the middle results or composition as a post-processing step to refine the stereo matching results. This cannot be optimized end-to-end and the performance is limited by the quality of the tri-modal output. To handle this issue, in this paper, we pursue an end-to-end hierarchical architecture and propose a differentiable confidence propagation (DCP) model of a cost aggregation network for stereo matching. The DCP model is integrated into an end-to-end neural network hierarchical architecture to guide matching cost volume aggregation. More specifically, to better represent the similarity of left and right feature maps, we extract unary context feature maps with an effective attention mechanism for matching cost construction. Moreover, we aggregate the cost volume with the multiple stacked DCP cost aggregation (DCPCA) networks to generate a more reliable and finer cost volume. This network suppresses multi-level disparity maps. Each output disparity is supervised with different training weights to learn in a coarse-to-fine way. Our method outperforms previous methods on the Sceneflow dataset by achieving the $0.6735px$ EPE error, achieving 1.53% D1-all metric of Non-occluded pixels regions and 0.72% Non-occluded pixels of $5px$ metric on KITTI 2015 and 2012 dataset. Extensive experiments carried out on the KITTI Stereo benchmarks demonstrate that our DCPCA-Net can significantly minimize the trade-off between accuracy and efficiency for stereo matching.

Multi-Dimensional Cooperative Network for Stereo Matching

A Joint 2D-3D Complementary Network for Stereo Matching

Multi-Scale Cost Volumes Cascade Network for Stereo Matching

Bidirectional Stereo Matching Network With Double Cost Volumes

Re-Parameterized Real-Time Stereo Matching Network Based on Mixed Cost Volumes Toward Autonomous Driving

Multi-scale Cross-form Pyramid Network for Stereo Matching

Stereo Matching Using Multi-Level Cost Volume and Multi-Scale Feature Constancy

Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlation

Multi-Dimensional Attention on Cost Volume for Stereo Matching

Self-adaptive Multi-scale Aggregation Network for Stereo Matching.

A Hybrid 2D and 3D Convolution Neural Network for Stereo Matching

Improved real-time three-dimensional stereo matching with local consistency

Stereo Matching Method Based on Space-Aware Network Model

Cascaded multi-scale and multi-dimension convolutional neural network for stereo matching.

Area-based Correlation and Non-Local Attention Network for Stereo Matching

Multi-Level Context Ultra-Aggregation for Stereo Matching

AP-Net: Attention-fused Volume and Progressive Aggregation for Accurate Stereo Matching

Deep Confidence Propagation Stereo Network

Cascaded Feature Interaction Network for Stereo Matching

Efficient and Accurate Stereo Matching Via Guided Deformable Aggregation

Deep Stereo Matching With Hysteresis Attention and Supervised Cost Volume Construction