Abstract:With the development of remote sensing satellite technology for Earth observation, remote sensing stereo images have been used for three-dimensional reconstruction in various fields, such as urban planning and construction. However, remote sensing images often contain noise, occluded regions, untextured areas, and repeated textures, which can lead to reduced accuracy in stereo matching and affect the quality of 3D reconstruction results. To reduce the impact of complex scenes in remote sensing images on stereo matching and to ensure both speed and accuracy, we propose a new end-to-end stereo matching network based on convolutional neural networks (CNNs). The proposed stereo matching network can learn features at different scales from the original images and construct cost volumes with varying scales to obtain richer scale information. Additionally, when constructing the cost volume, we introduce negative disparity to adapt to the common occurrence of both negative and non-negative disparities in remote sensing stereo image pairs. For cost aggregation, we employ a 3D convolution-based encoder–decoder structure that allows the network to adaptively aggregate information. Before feature aggregation, we also introduce an attention module to retain more valuable feature information, enhance feature representation, and obtain a higher-quality disparity map. By training on the publicly available US3D dataset, we obtain an accuracy of 1.115 pixels in end-point error (EPE) and 5.32% in the error pixel ratio (D1) on the test dataset, and the inference speed is 92 ms. Comparing our model with existing state-of-the-art models, we achieve higher accuracy, and the network is beneficial for the three-dimensional reconstruction of remote sensing images.

Automatic Tag Saliency Ranking for Stereo Images

Learning Stereoscopic Visual Attention Model for 3d Video

Salient Object Detection and Classification for Stereoscopic Images

Stereo image quality assessment based on visual attention

Saliency Detection for Stereoscopic Images Based on Depth Confidence Analysis and Multiple Cues Fusion

A Novel Saliency Model for Stereoscopic Images.

Stereoscopic visual saliency prediction based on stereo contrast and stereo focus

Stereoscopic Image Quality Assessment Method Based on Binocular Combination Saliency Model

Stereoscopic Thumbnail Creation Via Efficient Stereo Saliency Detection

Object segmentation using stereo images

A Three-Pathway Psychobiological Framework of Salient Object Detection Using Stereoscopic Technology.

A Computational Model for Stereoscopic Visual Saliency Prediction

Towards Top-Down Stereo Image Quality Assessment via Stereo Attention

Quality Assessment Metric of Stereo Images Considering Cyclopean Integration and Visual Saliency.

S3Net: Innovating Stereo Matching and Semantic Segmentation with a Single-Branch Semantic Stereo Network in Satellite Epipolar Imagery

Stereo Matching Method for Remote Sensing Images Based on Attention and Scale Fusion

EAI-Stereo: Error Aware Iterative Network for Stereo Matching

No Reference Quality Assessment of Stereo Video Based on Saliency and Sparsity.

Superpixel Guided Network for Three-Dimensional Stereo Matching

Saliency Inspired Quality Assessment of Stereoscopic 3D Video

No-reference stereoscopic image quality assessment using 3D visual saliency maps fused with three-channel convolutional neural network