Multilevel Features Fused and Change Information Enhanced Neural Network for Hyperspectral Image Change Detection

Jigang Ding,Xiaorun Li,Shu Xiang,Shuhan Chen
DOI: https://doi.org/10.1109/tgrs.2023.3344784
IF: 8.2
2023-01-01
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Hyperspectral image change detection (HSI CD) refers to identifying and analyzing differences between two HSIs acquired in the same area but at different times. However, current deep learning (DL)-based methods have limitations in fully exploiting the change information between bitemporal images and utilizing multilevel features. To address these issues, we propose a novel Multi-level features Fused and Change information Enhanced neural Network (MFCEN) for HSI CD. The proposed MFCEN method leverages the hierarchical low- and high-level features of bitemporal images, allowing for the direct capture and enhancement of change features. First, a Siamese-based network is employed to extract multilevel features from the bitemporal images, including low-level spatial details and high-level semantic features. Within the temporal change information branch (TCIB) at each level, the change features are reinforced by the semantic features of each image, and the change features act as a guiding force to direct the feature extraction of each bitemporal image to focus more on the change region. Next, the enhanced change features of each level are fed into the multilevel features fusion module (MFFM) to aggregate the fine-grained details and high-level semantics. Finally, the fused features, enriched with multilevel change information, are utilized for CD. The experiments demonstrate that our proposed MFCEN outperforms existing methods on three public datasets. The code will be available at https://github.com/Ding201901/MFCEN .
What problem does this paper attempt to address?