Abstract:Despite the significant progress made in deep learning-based stereo matching, the accuracy of these methods significantly decreases when faced with challenges such as occlusions, reflections, textureless areas, and scale variations. In this paper, we propose MSCANet, a novel stereo matching network that integrates multi-scale inputs and context-aware aggregation ability. MSCANet effectively integrates rich multi-scale feature information and exhibits context-aware capability, thereby enabling it to achieve superior performance. Firstly, a multi-scale aware fusion module is designed to efficiently incorporate more comprehensive global context features at different scales, which allows the model to enhance its ability to generalize across images of varying scales. Secondly, a novel V-shaped encoder/decoder module is developed to effectively exploit the rich feature information. In the encoding stage, a 3D squeeze-and-excitation block is introduced to facilitate adaptively recalibration of learned feature maps. This block effectively suppresses irrelevant features while enhancing useful features, which improved efficiency and accuracy in disparity prediction. Additionally, a 3D context-aware decode block is designed to effectively utilize global context features to restore the original image structure during the decoding stage. Moreover, the high-level feature maps can be employed to augment low-level feature maps by incorporating more detailed information to avoid the side effects caused by the loss of information during the encoding process. Extensive ablation experiments and comparative experiments were conducted on Scene Flow dataset, KITTI2012 and KITTI2015 datasets to validate the effectiveness of each proposed module. The experimental results demonstrate MSCANet achieves competitive performance and offers a more straightforward and efficient model design, as well as faster inference speed.

Multi-Scale Context Attention Network for Image Retrieval.

Multi-Scale Cross-Attention Fusion Network Based on Image Super-Resolution

Context-Aware Residual Module for Image Classification.

Hyperspectral Classification Via Spatial Context Exploration with Multi-Scale CNN

A Multi-scale Contextual Attention Mechanism for Convolutional Neural Networks

Multi-scale coupled attention for visual object detection

Wide-Context Attention Network for Remote Sensing Image Retrieval.

Cascaded Multi-Scale Attention for Enhanced Multi-Scale Feature Extraction and Interaction with Low-Resolution Images

Multi-scale inputs and context-aware aggregation network for stereo matching

Multi-scale attention network for image super-resolution

MCA: Multidimensional Collaborative Attention in Deep Convolutional Neural Networks for Image Recognition

Multibranch Spatial-Channel Attention for Semantic Labeling of Very High-Resolution Remote Sensing Images.

Exploring multi-scale deformable context and channel-wise attention for salient object detection

Multi-Scale Cross-Modal Spatial Attention Fusion for Multi-label Image Recognition.

Multi-scale Non-Local Attention Network for Image Super-Resolution

Multiscale Global Context Network for Semantic Segmentation of High-Resolution Remote Sensing Images

A Multi-Scale Layer-Channel Attention Network for Image Super-Resolution

High-Resolution Remote Sensing Image Semantic Segmentation via Multiscale Context and Linear Self-Attention

A Multiscale Attention Network for Remote Sensing Scene Images Classification

Spatial Global Context Attention for Convolutional Neural Networks: an Efficient Method

MC-Net: multi-scale context-attention network for medical CT image segmentation