Abstract:Despite the significant progress made in deep learning-based stereo matching, the accuracy of these methods significantly decreases when faced with challenges such as occlusions, reflections, textureless areas, and scale variations. In this paper, we propose MSCANet, a novel stereo matching network that integrates multi-scale inputs and context-aware aggregation ability. MSCANet effectively integrates rich multi-scale feature information and exhibits context-aware capability, thereby enabling it to achieve superior performance. Firstly, a multi-scale aware fusion module is designed to efficiently incorporate more comprehensive global context features at different scales, which allows the model to enhance its ability to generalize across images of varying scales. Secondly, a novel V-shaped encoder/decoder module is developed to effectively exploit the rich feature information. In the encoding stage, a 3D squeeze-and-excitation block is introduced to facilitate adaptively recalibration of learned feature maps. This block effectively suppresses irrelevant features while enhancing useful features, which improved efficiency and accuracy in disparity prediction. Additionally, a 3D context-aware decode block is designed to effectively utilize global context features to restore the original image structure during the decoding stage. Moreover, the high-level feature maps can be employed to augment low-level feature maps by incorporating more detailed information to avoid the side effects caused by the loss of information during the encoding process. Extensive ablation experiments and comparative experiments were conducted on Scene Flow dataset, KITTI2012 and KITTI2015 datasets to validate the effectiveness of each proposed module. The experimental results demonstrate MSCANet achieves competitive performance and offers a more straightforward and efficient model design, as well as faster inference speed.

Convolutional Neural Network Using Multi-Scale Information for Stereo Matching Cost Computation

Efficient Large Scale Stereo Matching Based on Cross-Scale.

Cascaded multi-scale and multi-dimension convolutional neural network for stereo matching.

Disparity Estimation Using Multilevel and Global Information

Multi-Scale Cost Volumes Cascade Network for Stereo Matching

Stereo Matching Using Multi-Level Cost Volume and Multi-Scale Feature Constancy

End-to-End Learning of Multi-scale Convolutional Neural Network for Stereo Matching

MCNet: Rethinking the Core Ingredients for Accurate and Efficient Homography Estimation

Multi-scale Cross-form Pyramid Network for Stereo Matching

Cross-Scale Cost Aggregation for Stereo Matching

Lightweight multi-scale convolutional neural network for real time stereo matching

Stereo Matching Method for Remote Sensing Images Based on Attention and Scale Fusion

Multi-Scale Context Attention Network for Stereo Matching

Exploiting Semantic and Boundary Information for Stereo Matching

Multi-Dimensional Cooperative Network for Stereo Matching

Hierarchical and Multi-Level Cost Aggregation for Stereo Matching.

Self-adaptive Multi-scale Aggregation Network for Stereo Matching.

Multi-scale inputs and context-aware aggregation network for stereo matching

Group-Based Atrous Convolution Stereo Matching Network

Multi-scale Matching Networks for Semantic Correspondence

An efficient and accurate multi-level cascaded recurrent network for stereo matching