Abstract:Despite the significant progress made in deep learning-based stereo matching, the accuracy of these methods significantly decreases when faced with challenges such as occlusions, reflections, textureless areas, and scale variations. In this paper, we propose MSCANet, a novel stereo matching network that integrates multi-scale inputs and context-aware aggregation ability. MSCANet effectively integrates rich multi-scale feature information and exhibits context-aware capability, thereby enabling it to achieve superior performance. Firstly, a multi-scale aware fusion module is designed to efficiently incorporate more comprehensive global context features at different scales, which allows the model to enhance its ability to generalize across images of varying scales. Secondly, a novel V-shaped encoder/decoder module is developed to effectively exploit the rich feature information. In the encoding stage, a 3D squeeze-and-excitation block is introduced to facilitate adaptively recalibration of learned feature maps. This block effectively suppresses irrelevant features while enhancing useful features, which improved efficiency and accuracy in disparity prediction. Additionally, a 3D context-aware decode block is designed to effectively utilize global context features to restore the original image structure during the decoding stage. Moreover, the high-level feature maps can be employed to augment low-level feature maps by incorporating more detailed information to avoid the side effects caused by the loss of information during the encoding process. Extensive ablation experiments and comparative experiments were conducted on Scene Flow dataset, KITTI2012 and KITTI2015 datasets to validate the effectiveness of each proposed module. The experimental results demonstrate MSCANet achieves competitive performance and offers a more straightforward and efficient model design, as well as faster inference speed.

Multi-Scale Dense Attention Network for Stereo Matching

Multi-Scale Context Attention Network for Stereo Matching

AMDCNet: an Attentional Multi-Directional Convolutional Network for Stereo Matching

MPA-Net: Multi-Path Attention Stereo Matching Network.

Multi-Dimensional Attention on Cost Volume for Stereo Matching

MA-Stereo: Real-Time Stereo Matching Via Multi-Scale Attention Fusion and Spatial Error-Aware Refinement

End-to-End Learning of Multi-scale Convolutional Neural Network for Stereo Matching

Multi-scale Cross-form Pyramid Network for Stereo Matching

Multi-scale inputs and context-aware aggregation network for stereo matching

A Convolutional Attention Residual Network for Stereo Matching

Cascaded multi-scale and multi-dimension convolutional neural network for stereo matching.

Multi-scale Alternated Attention Transformer for Generalized Stereo Matching

Self-adaptive Multi-scale Aggregation Network for Stereo Matching.

MSDC-Net: Multi-Scale Dense and Contextual Networks for Stereo Matching.

Self-Attention Multi-Scale Pyramid Stereo Matching Network

Attention-guided aggregation stereo matching network

Deeply-fused Attentive Network for Stereo Matching

MULTI-SCALE CASCADE DISPARITY REFINEMENT STEREO NETWORK

Dual Attention-Guided Self-Adaptive Aware Cascade Network for Multi-View Stereo and Stereo Matching

MSA-Net: Establishing Reliable Correspondences by Multiscale Attention Network.

A Fast Stereo Matching Network with Multi-Cross Attention