Abstract:Stereo matching of high-resolution satellite stereo images is a fundamental and challenging task in photogrammetry, geoscience and remote sensing. Some deep learning-based methods have shown great potential in solving this task recently. However, these methods have not attracted much attention as their accuracy is still unsatisfactory, especially in regions with intractable factors (e.g., occlusions, repetitive patterns, low/non-texture and disparity discontinuities. To tackle these challenging factors and improve disparity accuracy, we propose an end-to-end stereo matching network named Cascaded Multi-Scale Pyramid Network (CMSP-Net). Firstly, to fully utilize the multi-level spatial context information and mitigate the ambiguous matching caused by repetitive patterns, low/non-texture and occlusions, a cost volume pyramid is constructed with multi-scale image features. Then, each cost volume in the pyramid is aggregated with an hourglass structure to exploit the multi-scale context in a single cost volume. Secondly, considering that high-resolution cost volumes contain more detailed information but have small perception fields, while low-resolution ones have large perception fields but lack details, we design an Attention-Guided Inter-Scale Cost Fusion (AGCF) strategy to fuse pyramid cost volumes, which effectively integrates the advantages of multi-scale cost volumes while mitigating the backfiring caused by semantic inconsistency across different scales. Thirdly, a disparity refinement module is designed to improve overall disparity accuracy further, which incorporates the reconstruction error and edge clues of input satellite stereo images. Extensive experimental results on multiple satellite datasets demonstrate that the proposed method can effectively reduce matching ambiguities and recover sharp disparity discontinuities, achieving clear superiority over existing state-of-the-art methods.

A stereo matching network with a cascade spatial pyramid pooling (CSPP) substructure

Disparity Estimation Using Multilevel and Global Information

Cascaded multi-scale and multi-dimension convolutional neural network for stereo matching.

EdgeStereo: A Context Integrated Residual Pyramid Network for Stereo Matching

Cascaded Feature Interaction Network for Stereo Matching

Towards accurate binocular vision of satellites: A Cascaded Multi-Scale Pyramid Network for stereo matching on satellite imagery

Group-Based Atrous Convolution Stereo Matching Network

End-to-End Learning of Multi-scale Convolutional Neural Network for Stereo Matching

An efficient and accurate multi-level cascaded recurrent network for stereo matching

A Multi-Correlation Stereo Matching Network for Disparity Estimation

MULTI-SCALE CASCADE DISPARITY REFINEMENT STEREO NETWORK

Multi-scale Cross-form Pyramid Network for Stereo Matching

Stereo Matching Using Multi-Level Cost Volume and Multi-Scale Feature Constancy

Stereo Matching Method for Remote Sensing Images Based on Attention and Scale Fusion

Disparity Estimation Disparity Refinement Disparity Convolution Correlation Initial Disparity Residual Deconvolution Refined Disparity Reconstruction Error Shared Weights Skip Connection

Parallax attention stereo matching network based on the improved group-wise correlation stereo network

Dual Attention-Guided Self-Adaptive Aware Cascade Network for Multi-View Stereo and Stereo Matching

Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlation

Multi-Scale Cost Volumes Cascade Network for Stereo Matching

A Fast Stereo Matching Network with Multi-Cross Attention

A Light-Weight Network with Multi-Scale Features Fusion and Color Guidance for Stereo Matching