Abstract:Stereo matching of high-resolution satellite stereo images is a fundamental and challenging task in photogrammetry, geoscience and remote sensing. Some deep learning-based methods have shown great potential in solving this task recently. However, these methods have not attracted much attention as their accuracy is still unsatisfactory, especially in regions with intractable factors (e.g., occlusions, repetitive patterns, low/non-texture and disparity discontinuities. To tackle these challenging factors and improve disparity accuracy, we propose an end-to-end stereo matching network named Cascaded Multi-Scale Pyramid Network (CMSP-Net). Firstly, to fully utilize the multi-level spatial context information and mitigate the ambiguous matching caused by repetitive patterns, low/non-texture and occlusions, a cost volume pyramid is constructed with multi-scale image features. Then, each cost volume in the pyramid is aggregated with an hourglass structure to exploit the multi-scale context in a single cost volume. Secondly, considering that high-resolution cost volumes contain more detailed information but have small perception fields, while low-resolution ones have large perception fields but lack details, we design an Attention-Guided Inter-Scale Cost Fusion (AGCF) strategy to fuse pyramid cost volumes, which effectively integrates the advantages of multi-scale cost volumes while mitigating the backfiring caused by semantic inconsistency across different scales. Thirdly, a disparity refinement module is designed to improve overall disparity accuracy further, which incorporates the reconstruction error and edge clues of input satellite stereo images. Extensive experimental results on multiple satellite datasets demonstrate that the proposed method can effectively reduce matching ambiguities and recover sharp disparity discontinuities, achieving clear superiority over existing state-of-the-art methods.

Bi-window based stereo matching using combined Siamese convolutional neural network

Binocular Depth Estimation Using Convolutional Neural Network With Siamese Branches.

Efficient Binocular Stereo Matching Based on Sad and Improved Census Transformation

Adaptive Cost Volume Representation for Unsupervised High-resolution Stereo Matching

Cascaded multi-scale and multi-dimension convolutional neural network for stereo matching.

A-SATMVSNet: an Attention-Aware Multi-View Stereo Matching Network Based on Satellite Imagery

Stereo Matching Method for Remote Sensing Images Based on Attention and Scale Fusion

Towards accurate binocular vision of satellites: A Cascaded Multi-Scale Pyramid Network for stereo matching on satellite imagery

Patch-Based Stereo Matching Using 3D Convolutional Neural Networks

Computing the Stereo Matching Cost with a Convolutional Neural Network

Multi-Scale Binocular Stereo Matching Based on Semantic Association

Stereo Matching Based on Two Cameras and One 3D Image Sensor.

HLocalExp-CM: confidence map by hierarchical local expansion moves for accurate stereo matching

Local Stereo Matching with Side Window

Local Similarity Pattern and Cost Self-Reassembling for Deep Stereo Matching Networks

Dense Stereo Matching Based on PCNN

Robust Stereo Matching Using Improved ZNCC Combined SAD-LBP

Multi-Scale Cost Volumes Cascade Network for Stereo Matching

A Hybrid 2D and 3D Convolution Neural Network for Stereo Matching

Semi-dense Stereo Matching using Dual CNNs

Area-based Correlation and Non-Local Attention Network for Stereo Matching