CAST: A Cascade Spectral-Aware Transformer for Hyperspectral Image Change Detection.

Xiangrong Zhang,Shunli Tian,Guanchun Wang,Xu Tang,Jie Feng,Licheng Jiao
DOI: https://doi.org/10.1109/tgrs.2023.3304681
IF: 8.2
2023-01-01
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Hyperspectral image change detection (HSI-CD) aims to detect subtle changes on the Earth's surface through approximately continuous spectral information, which has gradually become a very important research hotspot in the field of remote sensing (RS). In recent years, convolutional neural networks (CNNs)-based HSI-CD methods have shown strong feature extraction capabilities. However, due to the simple fusion of spectral information in the channel dimension by CNN, the medium-and long-term sequence properties of spectral features cannot be well mined and represented. Most previous studies mainly extract semantic features from images at different times, ignoring the temporal correlation between features, which cannot fully extract and effectively utilize temporal-spatial- spectral features. To this end, this article proposes a cascade spectral-aware transformer (CAST) for HSI-CD. First, we pro-pose a temporal-spatial transformer (TS-Former) to enhance the temporal correlation and spatial global relationship of extracted features, thereby addressing the insufficient consideration of temporal correlation. Second, a spectral-awareness transformer (SA-Former) is designed to better mine and represent the sequence properties of spectral features, especially the medium -and long-term dependencies. Finally, we observe a spectral distortion in the process of extracting temporal-spatial features and, based on this, present a spectral constraint module (SCM) to preserve the sequence properties of spectral features and reduce the distortion of the spectrum. Extensive experiments on three challenging hyperspectral datasets demonstrate that our method achieves state-of-the-art results. The code is available at https://github.com/tianshunli/CAST.
What problem does this paper attempt to address?