Abstract:Multisource remote sensing images have rich features and high interpretability and are widely employed in many applications. However, highly unbalanced category distributions and complex backgrounds have created some difficulties in the application of remote sensing image semantic segmentation tasks, such as low accuracy of small target segmentation and inaccurate edge extraction. To solve these problems, in this paper, a feature map segmentation reconstruction module and an attention upsampling module are proposed. In the encoder part, the input feature map is equally segmented, and the segmented feature map is enlarged to effectively improve the small target feature information expression ability in the model. In the decoder part, the key segmentation and location information of shallow features are obtained using the global view. The deep semantic information and shallow spatial location information are fully combined to achieve a more refined upsampling operation. In addition, the attention mechanism of the spatial and channel squeeze and excitation block (scSE) is applied to pay more attention to important features and to suppress irrelevant background and redundant information. To verify the effectiveness of the proposed method, the WHU-OPT-SAR dataset and six state-of-the-art algorithms are utilized in comparative experiments. The experimental results show that our model has demonstrated the best performance and low computational complexity. With only approximately half the floating-point operation count and the number of model parameters of the MCANet model, which is specially designed for the dataset, our model surpasses MCANet by 1.52% and 1.53% in terms of mean intersection over union (mIoU) and F1 score, respectively. In particular, for small object regions such as roads and other categories, compared to the baseline model, the IoU and F1 score of our model are improved by 5.27% and 3.99% and by 5.68% and 5.65%, respectively. These results demonstrate the superior performance of our model in terms of accuracy and efficiency.

Integrating Detailed Features and Global Contexts for Semantic Segmentation in Ultra-High-Resolution Remote Sensing Images

Multi-Field Context Fusion Network for Semantic Segmentation of High-Spatial-Resolution Remote Sensing Images

Multiscale Cascaded Network for the Semantic Segmentation of High-Resolution Remote Sensing Images

A Multi-Step Fusion Network for Semantic Segmentation of High-Resolution Aerial Images

Multi-scale attention fusion network for semantic segmentation of remote sensing images

Multielement Feature-Based Hierarchical Context Integration Network for Remote Sensing Image Segmentation

Multi-source collaborative enhanced for remote sensing images semantic segmentation

Semantic Segmentation of Remote Sensing Image Based on Contextual U-Net

Semantic Segmentation for High Spatial Resolution Remote Sensing Images Based on Convolution Neural Network and Pyramid Pooling Module.

Semantic Segmentation of Remote-Sensing Images Based on Multiscale Feature Fusion and Attention Refinement

Semantic Segmentation of Very-High-Resolution Remote Sensing Images via Deep Multi-Feature Learning

High-Resolution Remote Sensing Image Semantic Segmentation via Multiscale Context and Linear Self-Attention

Muti-Scale Context-Aware Network for Cross-Domain Unsupervised Remote Sensing Image Semantic Segmentation

UHRSNet: A Semantic Segmentation Network Specifically for Ultra-High-Resolution Images

A Spectral–Spatial Context-Boosted Network for Semantic Segmentation of Remote Sensing Images

Semantic Labeling of High-Resolution Images Combining a Self-Cascaded Multimodal Fully Convolution Neural Network with Fully Conditional Random Field

Efficient Multi-scale Network for Semantic Segmentation of fine-Resolution Remotely Sensed Images

MFCSNet: Multi-Scale Deep Features Fusion and Cost-Sensitive Loss Function Based Segmentation Network for Remote Sensing Images

Semantic Segmentation for Multisource Remote Sensing Images Incorporating Feature Slice Reconstruction and Attention Upsampling

MOA-Net: Multilevel Object Aware Network for Remote Sensing Image Semantic Segmentation

PGNet: Positioning Guidance Network for Semantic Segmentation of Very-High-Resolution Remote Sensing Images