Abstract:As spatial resolution increases, the information conveyed by remote sensing images becomes more and more complex. Large-scale variation and highly discrete distribution of objects greatly increase the challenge of the semantic segmentation task for remote sensing images. Mainstream approaches usually use implicit attention mechanisms or transformer modules to achieve global context for good results. However, these approaches fail to explicitly extract intraobject consistency and interobject saliency features leading to unclear boundaries and incomplete structures. In this article, we propose a category-guided global–local feature interaction network (CGGLNet), which utilizes category information to guide the modeling of global contextual information. To better acquire global information, we proposed a category-guided supervised transformer module (CGSTM). This module guides the modeling of global contextual information by estimating the potential class information of pixels so that features of the same class are more aggregated and those of different classes are more easily distinguished. To enhance the representation of local detailed features of multiscale objects, we designed the adaptive local feature extraction module (ALFEM). By parallel connection of the CGSTM and the ALFEM, our network can extract rich global and local context information contained in the image. Meanwhile, the designed feature refinement segmentation head (FRSH) helps to reduce the semantic difference between deep and shallow features and realizes the full integration of different levels of information. Extensive ablation and comparison experiments on two public remote sensing datasets (ISPRS Vaihingen dataset and ISPRS Potsdam dataset) indicate that our proposed CGGLNet achieves superior performance compared to the state-of-the-art methods.

Consistency Graph Modeling for Semantic Correspondence

Bridging Visual and Textual Semantics: Towards Consistency for Unbiased Scene Graph Generation

Multi-scale Matching Networks for Semantic Correspondence

Joint Graph Learning and Matching for Semantic Feature Correspondence

Cross-Modal Image-Text Retrieval with Semantic Consistency

Cycle-Consistency Based Hierarchical Dense Semantic Correspondence

Deep Semantic Feature Matching Using Confidential Correspondence Consistency

CGGLNet: Semantic Segmentation Network for Remote Sensing Images Based on Category-Guided Global–Local Feature Interaction

Cross-Graph Attention Enhanced Multi-Modal Correlation Learning for Fine-Grained Image-Text Retrieval

Category-specific Semantic Coherency Learning for Fine-grained Image Recognition

Hierarchical Cross-Modal Graph Consistency Learning for Video-Text Retrieval.

Heterogeneous Graph Fusion Network for Cross-Modal Image-Text Retrieval

SEMScene: Semantic-Consistency Enhanced Multi-Level Scene Graph Matching for Image-Text Retrieval

Semantic Modeling of Textual Relationships in Cross-modal Retrieval

MS2DG-Net: Progressive Correspondence Learning Via Multiple Sparse Semantics Dynamic Graph

Object-Aware Dense Semantic Correspondence

A unified feature-spatial cycle consistency fusion framework for robust image matching

Cross-modal alignment with graph reasoning for image-text retrieval

SeCG: Semantic-Enhanced 3D Visual Grounding via Cross-modal Graph Attention

Cross-modal Graph Matching Network for Image-text Retrieval

Joint Intra & Inter-Grained Reasoning: A New Look into Semantic Consistency of Image-Text Retrieval