Background-Guided Deformable Convolutional Autoencoder for Hyperspectral Anomaly Detection
Zhaoyue Wu,Mercedes E. Paoletti,Hongjun Su,Xuanwen Tao,Lirong Han,Juan M. Haut,Antonio Plaza
DOI: https://doi.org/10.1109/tgrs.2023.3334562
IF: 8.2
2023-01-01
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Autoencoder (AE)-based hyperspectral anomaly detectors have received significant attention. The core of these detectors is to reconstruct backgrounds by optimizing AEs so that anomalies can be detected by reconstruction residuals. Nevertheless, existing methods are flawed in two aspects: 1) most of them reconstruct the background along with the anomalies, resulting in undesired performance for large target detection in complex backgrounds, and 2) they only focus on the encoder optimization part, ignoring the decoder reconstruction quality of the background. Given the above, this article proposes a background-guided deformable convolutional AE ( DCAE ) network with three mutually supportive parts, including encoder, decoder, and background guidance modules. In the encoder, deformable convolution (DC) is introduced into regular convolution to build the adaptive spatial feature extractor to fit complex spatial structures, while a nonlocal convolution (NLC) is introduced to build an external feature extractor to capture global spatial relationships. Furthermore, a mask is designed to filter potential anomalous information, curbing the representation of high-frequency anomalies to focus on widespread backgrounds. In the decoder, a background guidance module (considering the physical meaning of linear reconstruction) is built, guiding the proposed network learning via two strategies. One is initializing the weight of the decoder, and another is adding a loss term. Notably, both the number of output channels of the encoder and the decoder construction are determined by the background guidance module, which creates a bridge between the network design and practical situations. A profound analysis demonstrates the outstanding performance of the proposed method, which outperforms traditional and deep learning methods, proving that the novel designs introduced in the network architecture are extremely effective.