HFNet: Semantic and Differential Heterogenous Fusion Network for Remote Sensing Image Change Detection

Yang Han,Jiayi Li,Yang Qu,Leiguang Wang,Xiaofeng Pan,Xin Huang
DOI: https://doi.org/10.1007/s41651-024-00202-3
2024-01-01
Journal of Geovisualization and Spatial Analysis
Abstract:Existing methods of change detection that rely on individual image modalities, such as concatenation and differencing, risk overlooking the distinct change patterns, and detailed features inherent in different modalities. This oversight can result in missed detections and suboptimal delineation of change boundaries. To address these limitations, this study presents a novel semantic and differential heterogeneous fusion change detection method, termed HFNet (Heterogeneous Fusion Network). HFNet integrates two different bitemporal image input modes to analyze changes and detailed information within image pairs. To effectively integrate bitemporal-difference features, we have introduced a module called CFM (Correlation Fusion Module) in HFNet, designed to handle the bitemporal features of the concatenation branch and the differencing features of the Siamese branch. Furthermore, to exploit multiscale change information in images, we designed the GSFM (Global Scale Frequency Fusion) in the decoder stage to establish inter-scale dependencies and adaptively compute multiscale weights. In addition, to fully explore the spatiotemporal features of bitemporal images, we constructed a change detection feature extraction module with a hybrid spatiotemporal Convolution-Transformer structure, named STConvTrans. This feature extraction module is designed to efficiently extract and restore fine features from the temporally stacked branches of bitemporal images. Extensive experiments on public datasets demonstrate the superior performance of HFNet. Compared to the current state-of-the-art model, HFNet achieves improvements of 3.7
What problem does this paper attempt to address?