Abstract:The convolutional neural networks have recently gained widespread attention in Hyperspectral Image Change Detection (HSI-CD) due to their outstanding feature extraction ability. However, limited by the inherent network backbones, the convolutional neural networks (CNNs) fail to mine the sequence attributes and model the intricate relationships of spectral signatures. In contrast, transformers are proficient at learning sequence information owing to the powerful self-attention mechanisms. The two backbone structures exhibit complementary spatial and spectral feature extraction strengths, respectively. Inspired by this, we propose a dual-branch siamese spatial–spectral transformer attention network (DBS 3 TAN) for HSI-CD. The main idea is to fully exploit the advantages of CNNs and transformers for spatial and spectral feature extraction. More importantly, we devise the two key modules, i.e., the spatial attention module and the spatial–spectral transformer module. The former utilizes depthwise separable convolutions and attention mechanisms to emphasize the features of dual-temporal HSIs from the spatial perspective. The latter focuses on the sequence attributes of spectral signatures and mines the spatial characteristics from adjacent pixels. We employ the weighted contrastive loss function to separate the changed and unchanged pixels more reliably and set the random weight factors to balance the contributions of the two branches. Finally, the threshold values judgment is used to obtain the ultimate detection maps. We conduct extensive experiments to evaluate the DBS 3 TAN on three HSI datasets, demonstrating its superior performances than compared methods qualitatively and quantitatively. The source code will be available at https://github.com/zhangyiyan001/DBS3TAN .

A Spectral and Spatial Attention Network for Change Detection in Hyperspectral Images

Attention in Attention for Hyperspectral with High Spatial Resolution (H) Image Classification

A Spatial-Spectral-Temporal Attention Method for Hyperspectral Image Change Detection.

Multiple Spatial–Spectral Features Aggregated Neural Network for Hyperspectral Change Detection

Hyperspectral Image Change Detection Based on Gated Spectral–Spatial–Temporal Attention Network With Spectral Similarity Filtering

Multilevel Features Fused and Change Information Enhanced Neural Network for Hyperspectral Image Change Detection

SSA-LHCD: A Singular Spectrum Analysis-Driven Lightweight Network with 2-D Self-Attention for Hyperspectral Change Detection

CBW-MSSANet: A CNN Framework with Compact Band Weighting and Multiscale Spatial Attention for Hyperspectral Image Change Detection

A dual-branch siamese spatial-spectral transformer attention network for Hyperspectral Image Change Detection

One-Stream Neural Network Based on Multi-Level Features Fusion for Hyperspectral Image Change Detection

Attention-Based Spatial and Spectral Network with PCA-Guided Self-Supervised Feature Extraction for Change Detection in Hyperspectral Images

Change Detection in Hyperspectral Images Based on a Spatial-Spectral-Temporal Attention Network.

A Spectral-Spatial Multiscale Approach For Unsupervised Multiple Change Detection

Band Selection for Change Detection from Hyperspectral Images

Band Selection-Based Dimensionality Reduction for Change Detection in Multi-Temporal Hyperspectral Images

Cross-domain attention network for hyperspectral image classification

GETNET: A General End-to-End 2-D CNN Framework for Hyperspectral Image Change Detection

End-to-end Hyperspectral Image Change Detection Network Based on Band Selection

SSCNN-S: A Spectral-Spatial Convolution Neural Network with Siamese Architecture for Change Detection

Change Detection For Hyperspectral Images Via Convolutional Sparse Analysis And Temporal Spectral Unmixing

SpectralKAN: Kolmogorov-Arnold Network for Hyperspectral Images Change Detection