Abstract:With the development of remote sensing satellite technology for Earth observation, remote sensing stereo images have been used for three-dimensional reconstruction in various fields, such as urban planning and construction. However, remote sensing images often contain noise, occluded regions, untextured areas, and repeated textures, which can lead to reduced accuracy in stereo matching and affect the quality of 3D reconstruction results. To reduce the impact of complex scenes in remote sensing images on stereo matching and to ensure both speed and accuracy, we propose a new end-to-end stereo matching network based on convolutional neural networks (CNNs). The proposed stereo matching network can learn features at different scales from the original images and construct cost volumes with varying scales to obtain richer scale information. Additionally, when constructing the cost volume, we introduce negative disparity to adapt to the common occurrence of both negative and non-negative disparities in remote sensing stereo image pairs. For cost aggregation, we employ a 3D convolution-based encoder–decoder structure that allows the network to adaptively aggregate information. Before feature aggregation, we also introduce an attention module to retain more valuable feature information, enhance feature representation, and obtain a higher-quality disparity map. By training on the publicly available US3D dataset, we obtain an accuracy of 1.115 pixels in end-point error (EPE) and 5.32% in the error pixel ratio (D1) on the test dataset, and the inference speed is 92 ms. Comparing our model with existing state-of-the-art models, we achieve higher accuracy, and the network is beneficial for the three-dimensional reconstruction of remote sensing images.

Multiscale Stereo Matching Method for Small Baseline Based on Fuzzy Logic

A Simple Rectification Method for Linear Multi-Baseline Stereovision System

Efficient Large Scale Stereo Matching Based on Cross-Scale.

Dynamic Limited-Search Matching Algorithm Based on Geometric Properties of Stereo Imaging

Efficient Binocular Stereo Matching Based on Sad and Improved Census Transformation

Space-temporal stereo matching for dynamic scene

A Long Baseline Global Stereo Matching Based Upon Short Baseline Estimation

Stereo Matching Algorithm for Improved Census Transform and Gradient Fusion

Efficient Global Stereo-Matching Method of General Images under a Long Baseline Based on Baseline Estimation.

A Fast Local Stereo Matching Insensitive to Illumination Conditions

Stereo matching algorithm using improved guided filtering

Robust Region-Wise Colour Correction Method for Stereo Matching

Sparse LIDAR Measurement Fusion with Joint Updating Cost for Fast Stereo Matching

Phase-based learning for micro-baseline depth estimation

Local Expansion Moves for Stereo Matching Based on Random Sample Consensus Confidence

Dense Stereo Matching Algorithm Based on Image Segmentation

Stereo Matching by Incorporating Depth Cues

HLocalExp-CM: confidence map by hierarchical local expansion moves for accurate stereo matching

Stereo Matching Method for Remote Sensing Images Based on Attention and Scale Fusion

The Study of Stereo Matching Optimization Based on Multi-Baseline Trinocular Model

Stereo matching based on guided filter and segmentation