Abstract:The convolutional neural networks have recently gained widespread attention in Hyperspectral Image Change Detection (HSI-CD) due to their outstanding feature extraction ability. However, limited by the inherent network backbones, the convolutional neural networks (CNNs) fail to mine the sequence attributes and model the intricate relationships of spectral signatures. In contrast, transformers are proficient at learning sequence information owing to the powerful self-attention mechanisms. The two backbone structures exhibit complementary spatial and spectral feature extraction strengths, respectively. Inspired by this, we propose a dual-branch siamese spatial–spectral transformer attention network (DBS 3 TAN) for HSI-CD. The main idea is to fully exploit the advantages of CNNs and transformers for spatial and spectral feature extraction. More importantly, we devise the two key modules, i.e., the spatial attention module and the spatial–spectral transformer module. The former utilizes depthwise separable convolutions and attention mechanisms to emphasize the features of dual-temporal HSIs from the spatial perspective. The latter focuses on the sequence attributes of spectral signatures and mines the spatial characteristics from adjacent pixels. We employ the weighted contrastive loss function to separate the changed and unchanged pixels more reliably and set the random weight factors to balance the contributions of the two branches. Finally, the threshold values judgment is used to obtain the ultimate detection maps. We conduct extensive experiments to evaluate the DBS 3 TAN on three HSI datasets, demonstrating its superior performances than compared methods qualitatively and quantitatively. The source code will be available at https://github.com/zhangyiyan001/DBS3TAN .

A Spatial-Spectral-Temporal Attention Method for Hyperspectral Image Change Detection.

Attention in Attention for Hyperspectral with High Spatial Resolution (H) Image Classification

Multiple Spatial–Spectral Features Aggregated Neural Network for Hyperspectral Change Detection

A Spatial–Spectral Joint Attention Network for Change Detection in Multispectral Imagery

Change Detection in Hyperspectral Images Based on a Spatial-Spectral-Temporal Attention Network.

A Spectral and Spatial Attention Network for Change Detection in Hyperspectral Images

A Joint Saliency Temporal–Spatial–Spectral Information Network for Hyperspectral Image Change Detection

One-Stream Neural Network Based on Multi-Level Features Fusion for Hyperspectral Image Change Detection

A dual-branch siamese spatial-spectral transformer attention network for Hyperspectral Image Change Detection

CS-HSNet: A Cross-Siamese Change Detection Network Based on Hierarchical-Split Attention

Attention-Based Spatial and Spectral Network with PCA-Guided Self-Supervised Feature Extraction for Change Detection in Hyperspectral Images

Hyperspectral Image Change Detection Based on Gated Spectral–Spatial–Temporal Attention Network With Spectral Similarity Filtering

Multilevel Features Fused and Change Information Enhanced Neural Network for Hyperspectral Image Change Detection

Hyperspectral Image Change Detection Based on Active Convolutional Neural Network and Spatial–spectral Affinity Graph Learning

High-Resolution Remote Sensing Image Change Detection Based on Cross-Mixing Attention Network

CSANet: Cross-Temporal Interaction Symmetric Attention Network for Hyperspectral Image Change Detection

CBW-MSSANet: A CNN Framework with Compact Band Weighting and Multiscale Spatial Attention for Hyperspectral Image Change Detection

Spectral–Spatial–Temporal Transformers for Hyperspectral Image Change Detection

A Spectral–Spatial Change Detection Method Based on Simplified 3-D Convolutional Autoencoder for Multitemporal Hyperspectral Images

A Novel Hyperspectral Image Change Detection Framework Based on 3D-Wavelet Domain Active Convolutional Neural Network

Change Detection For Hyperspectral Images Via Convolutional Sparse Analysis And Temporal Spectral Unmixing