Abstract:Change detection (CD) has a significant application in the remote sensing field. Because of the popularity of hyperspectral image (HSI) and the application of deep learning methods, hyperspectral image change detection (HSI-CD) techniques have been greatly developed. Among them, convolutional neural network (CNN) has garnered the greatest interest in HSI-CD due to their superior feature learning capabilities. However, current CNN-based algorithms have trouble capturing spectral similarity and long-range dependency owing to their intrinsic structural restrictions. Recently, transformers have been shown to extract global dependency from nature images in an extremely efficient way. But it has some difficulties in handling high-dimensional data, such as HSI. To address these issues, we propose an improved multi-scale and spectral-wise transformer (MS-SWT). The proposed MS-SWT is capable of capturing spectral similarity and long-range dependence between bands to enhance the efficiency of the HSI-CD task. Furthermore, to maximize the utilization of spatial information, we present a multi-scale feature fusion module (MFFM) to extract and fuse different dimensions of spatial features. More importantly, a locality self-attention (LSA) module is employed to alleviate the problem of smoothing the distribution of attention scores due to the large number of spectral embeddings. Moreover, we design a channel self-supervised loss function that can capture intrinsic information from the spectral channels to further strengthen the robustness of model training when the training samples are scarce. Lastly, comprehensive experiments present the high performance of our MS-SWT on four bitemporal HSI datasets and demonstrate the superiority of MS-SWT over state-of-the-art approaches.

Change Detection For Hyperspectral Images Based On Tensor Analysis

Hyperspectral Change Detection Based on Change Vector Analysis and Spectral Unmixing

Change detection in hyperspectral imagery based on spectrally-spatially regularized low-rank matrix decomposition

Spectrally-Spatially Regularized Low-Rank And Sparse Decomposition: A Novel Method For Change Detection In Multitemporal Hyperspectral Images

TDSSC: A Three-Directions Spectral–Spatial Convolution Neural Network for Hyperspectral Image Change Detection

A Spatial-Spectral-Temporal Attention Method for Hyperspectral Image Change Detection.

Unsupervised Hierarchical Spectral Analysis for Change Detection in Hyperspectral Images

A Novel Hierarchical Method For Change Detection In Multitemporal Hyperspectral Images

Hyperspectral Change Detection Based on Multiple Morphological Profiles

Multiple Spatial–Spectral Features Aggregated Neural Network for Hyperspectral Change Detection

Enhanced Tensor Low-Rank Representation Learning for Hyperspectral Anomaly Detection

One-Stream Neural Network Based on Multi-Level Features Fusion for Hyperspectral Image Change Detection

Spectral–Spatial–Temporal Transformers for Hyperspectral Image Change Detection

Hierarchical Unsupervised Change Detection in Multitemporal Hyperspectral Images

Sequential Spectral Change Vector Analysis for Iteratively Discovering and Detecting Multiple Changes in Hyperspectral Images

Hyperspectral image change detection based on an improved multi-scale and spectral-wise transformer

A Joint Morphological Profiles and Patch Tensor Change Detection for Hyperspectral Imagery

Multilevel Features Fused and Change Information Enhanced Neural Network for Hyperspectral Image Change Detection

Low-rank Matrix Decomposition with a Spectral-Spatial Regularization for Change Detection in Hyperspectral Imagery

Multitemporal Symmetric Fusion Network for Hyperspectral Change Detection

Noise Reduction of Hyperspectral Imagery Based on Nonlocal Tensor Factorization.