Abstract:Current semantic change detection (SCD) methods face challenges in modeling temporal correlations (TCs) between bitemporal semantic features and difference features. These methods lead to inaccurate detection results, particularly for complex SCD scenarios. This paper presents a hierarchical semantic graph interaction network (HGINet) for SCD from high-resolution remote sensing images. This multitask neural network combines semantic segmentation and change detection tasks. For semantic segmentation, we construct a multilevel perceptual aggregation network with a pyramidal architecture. It extracts semantic features that discriminate between different categories at multiple levels. We model the correlations between bitemporal semantic features using a TC module that enhances the identification of unchanged areas. For change detection, we design a semantic difference interaction module based on a graph convolutional network. It measures the interactions among bitemporal semantic features, their corresponding difference features, and the combination of both. Extensive experiments on four datasets, namely SECOND, HRSCD, Fuzhou, and Xiamen, show that HGINet performs better in identifying changed areas and categories across various scenarios and regions than nine existing methods. Compared with the existing methods applied on the four datasets, it achieves the highest F1scd values of 59.48%, 64.12%, 64.45%, and 84.93%, and SeK values of 19.34%, 14.55%, 18.28%, and 51.12%, respectively. Moreover, HGINet mitigates the influence of fake changes caused by seasonal effects, producing results with well-delineated boundaries and shapes. Furthermore, HGINet trained on the Fuzhou dataset is successfully transferred to the Xiamen dataset, demonstrating its effectiveness and robustness in identifying changed areas and categories from high-resolution remote sensing images. The code of our paper is accessible at https://github.com/long123524/HGINet-torch.

SSTNet: A Network Based on Modeling of Semantic-spatio-temporal Information for Semantic Change Detection of Remote Sensing Images

Spatial-Temporal Semantic Perception Network for Remote Sensing Image Semantic Change Detection

Semantic Information Collaboration Network for Semantic Change Detection in Remote Sensing Images

FFPNet: Fine-Grained Feature Perception Network for Semantic Change Detection on Bi-Temporal Remote Sensing Images

Change-Guided Similarity Pyramid Network for Semantic Change Detection

CS-HSNet: A Cross-Siamese Change Detection Network Based on Hierarchical-Split Attention

A Semi-Supervised Semantic and Spatial Change Detail Retention Network for Semantic Change Detection in Remote Sensing Images

Spatially and Semantically Enhanced Siamese Network for Semantic Change Detection in High-Resolution Remote Sensing Images

TBSCD-Net: A Siamese Multi-task Network Integrating Transformers and Boundary Regularization for Semantic Change Detection from VHR Satellite Images

Semantic Change Detection Using a Hierarchical Semantic Graph Interaction Network from High-Resolution Remote Sensing Images

SSCFNet: A Spatial-Spectral Cross Fusion Network for Remote Sensing Change Detection

TTNet: A Temporal-Transform Network for Semantic Change Detection Based on Bi-Temporal Remote Sensing Images

Joint Spatio-Temporal Modeling for Semantic Change Detection in Remote Sensing Images

Remote Sensing Semantic Change Detection Model for Improving Objects Completeness

Multi-scale Semantic Representation and Supervision for Remote Sensing Change Detection.

Remote Sensing Image Semantic Change Detection Boosted by Semi-supervised Contrastive Learning of Semantic Segmentation

MFDS-Net: Multiscale Feature Depth-Supervised Network for Remote Sensing Change Detection With Global Semantic and Detail Information

A New Semisupervised Method for Detecting Semantic Changes in Remote Sensing Images.

SMD-Net: Siamese Multi-Scale Difference-Enhancement Network for Change Detection in Remote Sensing

SiameseNet Based Fine-Grained Semantic Change Detection for High Resolution Remote Sensing Images

SCDNET: A novel convolutional network for semantic change detection in high resolution optical remote sensing imagery