Abstract:As spatial resolution increases, the information conveyed by remote sensing images becomes more and more complex. Large-scale variation and highly discrete distribution of objects greatly increase the challenge of the semantic segmentation task for remote sensing images. Mainstream approaches usually use implicit attention mechanisms or transformer modules to achieve global context for good results. However, these approaches fail to explicitly extract intraobject consistency and interobject saliency features leading to unclear boundaries and incomplete structures. In this article, we propose a category-guided global–local feature interaction network (CGGLNet), which utilizes category information to guide the modeling of global contextual information. To better acquire global information, we proposed a category-guided supervised transformer module (CGSTM). This module guides the modeling of global contextual information by estimating the potential class information of pixels so that features of the same class are more aggregated and those of different classes are more easily distinguished. To enhance the representation of local detailed features of multiscale objects, we designed the adaptive local feature extraction module (ALFEM). By parallel connection of the CGSTM and the ALFEM, our network can extract rich global and local context information contained in the image. Meanwhile, the designed feature refinement segmentation head (FRSH) helps to reduce the semantic difference between deep and shallow features and realizes the full integration of different levels of information. Extensive ablation and comparison experiments on two public remote sensing datasets (ISPRS Vaihingen dataset and ISPRS Potsdam dataset) indicate that our proposed CGGLNet achieves superior performance compared to the state-of-the-art methods.

UGCNet: An Unsupervised Semantic Segmentation Network Embedded With Geometry Consistency for Remote-Sensing Images

Optimizing Spatial Relationships in GCN to Improve the Classification Accuracy of Remote Sensing Images

Unbalanced Class Learning Network With Scale-Adaptive Perception for Complicated Scene in Remote Sensing Images Segmentation

Consistency-Regularized Region-Growing Network for Semantic Segmentation of Urban Scenes With Point-Level Annotations

Building Extraction From High-Resolution Aerial Imagery Using A Generative Adversarial Network With Spatial And Channel Attention Mechanisms

Semantic Segmentation of High-Resolution Remote Sensing Images with Improved U-Net Based on Transfer Learning

RSI-Net: Two-Stream Deep Neural Network for Remote Sensing Images-Based Semantic Segmentation

Semisupervised Multiscale Generative Adversarial Network for Semantic Segmentation of Remote Sensing Image.

Multi-Attention-Based Semantic Segmentation Network for Land Cover Remote Sensing Images

CGGLNet: Semantic Segmentation Network for Remote Sensing Images Based on Category-Guided Global–Local Feature Interaction

MACU-Net for Semantic Segmentation of Fine-Resolution Remotely Sensed Images

CTMU-Net: an Improved U-Net for Semantic Segmentation of Remote-Sensing Images Based on the Combined Attention Mechanism

RS3Mamba: Visual State Space Model for Remote Sensing Image Semantic Segmentation

A Spectral–Spatial Context-Boosted Network for Semantic Segmentation of Remote Sensing Images

Semantic Segmentation of Remote Sensing Images by Interactive Representation Refinement and Geometric Prior-Guided Inference

Global Context Dependencies Aware Network for Efficient Semantic Segmentation of Fine-Resolution Remoted Sensing Images

Efficient Multi-scale Network for Semantic Segmentation of fine-Resolution Remotely Sensed Images

U-Net Ensemble for Enhanced Semantic Segmentation in Remote Sensing Imagery

Semi-Supervised Semantic Segmentation of Remote Sensing Images With Iterative Contrastive Network

Multi-source collaborative enhanced for remote sensing images semantic segmentation

Enhancing Efficient Global Understanding Network with CSWin Transformer for Urban Scene Images Segmentation