RSAAE: Residual Self-Attention-Based Autoencoder for Hyperspectral Anomaly Detection.

Liguo Wang,Xiaoyi Wang,Anna Vizziello,Paolo Gamba
DOI: https://doi.org/10.1109/tgrs.2023.3271719
IF: 8.2
2023-01-01
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Autoencoder (AE) has been widely used in the field of hyperspectral anomaly detection. It is assumed that the background can be reconstructed well, but the anomalies cannot. Hence, the pixels with larger reconstruction errors are considered anomalies. However, owing to the strong nonlinear representation ability of AE, it is difficult to distinguish between background and anomalies. To address this problem, we propose a residual self-attention-based AE (RSAAE) for hyperspectral anomaly detection. RSAAE consists of dense residual self-attention (RSA) modules, an encoder, and a decoder. First, a novel RSA module is designed, which can effectively extract the main features and weaken the ability of subsequent networks to reconstruct anomalies, as well as preserve the original features to avoid the deterioration of network performance after the use of dense self-attention modules. Furthermore, inspired by manifold learning, we assume that the background is low-rank in the original space, and has the same property in the latent space after dimensionality reduction. We proposed a low-rank loss function to constrain the latent space, thereby suppressing anomaly reconstruction. Experiments on four real hyperspectral image (HSI) datasets showed that the proposed RSAAE method can produce more accurate detection results than eight popular methods.
What problem does this paper attempt to address?