Abstract:Despite the significant progress made in deep learning-based stereo matching, the accuracy of these methods significantly decreases when faced with challenges such as occlusions, reflections, textureless areas, and scale variations. In this paper, we propose MSCANet, a novel stereo matching network that integrates multi-scale inputs and context-aware aggregation ability. MSCANet effectively integrates rich multi-scale feature information and exhibits context-aware capability, thereby enabling it to achieve superior performance. Firstly, a multi-scale aware fusion module is designed to efficiently incorporate more comprehensive global context features at different scales, which allows the model to enhance its ability to generalize across images of varying scales. Secondly, a novel V-shaped encoder/decoder module is developed to effectively exploit the rich feature information. In the encoding stage, a 3D squeeze-and-excitation block is introduced to facilitate adaptively recalibration of learned feature maps. This block effectively suppresses irrelevant features while enhancing useful features, which improved efficiency and accuracy in disparity prediction. Additionally, a 3D context-aware decode block is designed to effectively utilize global context features to restore the original image structure during the decoding stage. Moreover, the high-level feature maps can be employed to augment low-level feature maps by incorporating more detailed information to avoid the side effects caused by the loss of information during the encoding process. Extensive ablation experiments and comparative experiments were conducted on Scene Flow dataset, KITTI2012 and KITTI2015 datasets to validate the effectiveness of each proposed module. The experimental results demonstrate MSCANet achieves competitive performance and offers a more straightforward and efficient model design, as well as faster inference speed.

Multi-Scale Correlation for Deep Homography Estimation

MCNet: Rethinking the Core Ingredients for Accurate and Efficient Homography Estimation

Deep Homography Estimation With Feature Correlation Transformer

Dynamic Convolution Covariance Network Using Multi-Scale Feature Fusion for Remote Sensing Scene Image Classification

Deep Phase Correlation for End-to-End Heterogeneous Sensor Measurements Matching.

Multi-scale Matching Networks for Semantic Correspondence

LocalTrans: A Multiscale Local Transformer Network for Cross-Resolution Homography Estimation

Unsupervised deep homography with multi-scale global attention.

Coarse-to-Fine Homography Estimation for Infrared and Visible Images

STN-Homography: Direct Estimation of Homography Parameters for Image Pairs

SCPNet: Unsupervised Cross-modal Homography Estimation via Intra-modal Self-supervised Learning

Multi-scale inputs and context-aware aggregation network for stereo matching

CrossHomo: Cross-Modality and Cross-Resolution Homography Estimation

Deep Homography Estimation with Pairwise Invertibility Constraint.

Bilevel progressive homography estimation via correlative region-focused transformer

MSDC-Net: Multi-Scale Dense and Contextual Networks for Automated Disparity Map for Stereo Matching

Multi-scale coupled attention for visual object detection

AbHE: All Attention-Based Homography Estimation

Multi-Scale Structure-Aware Network for Human Pose Estimation

Multi-scale Cross-form Pyramid Network for Stereo Matching

Cascaded multi-scale and multi-dimension convolutional neural network for stereo matching.