One-Stream Neural Network Based on Multi-Level Features Fusion for Hyperspectral Image Change Detection

Jigang Ding,Xiaorun Li,Shuhan Chen
DOI: https://doi.org/10.1109/igarss53475.2024.10641493
2024-01-01
Abstract:The need for precise and efficient monitoring of the Earth’s surface has become increasingly urgent. However, existing methods primarily rely on Siamese-based neural network, which both restrict the extraction of change information and reduce computational efficiency. To address these issues, we propose a One-Stream neural network (OSMT) based on Multi-level feature Fusion for hyperspectral image (HSI) change detection (CD). The proposed method leverages the multi-level semantic change features of the bi-temporal images. First, a band-wise image fusion strategy is utilized to obtain the fused difference image of the bi-temporal HSIs. Then, a residual connection block with spatial-spectral attention mechanism is employed to extract multi-level change features. Next, a multi-level feature fusion module composed of Transformer encoders is used to fuse the change features of different levels, including spatial details at the lower level and semantic information at the higher level. Finally, a classifier is employed to predict the detection results. Experimental results on one public dataset validate the effectiveness of our proposed method.
What problem does this paper attempt to address?