Spatial-Spectral Contrastive Self-Supervised Learning With Dual Path Networks for Hyperspectral Target Detection

Xi Chen,Yuxiang Zhang,Yanni Dong,Bo Du
DOI: https://doi.org/10.1109/tgrs.2024.3390946
IF: 8.2
2024-04-30
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Deep learning (DL) has shown great success in hyperspectral target detection (HTD). Because of the limited targets of interest in the hyperspectral image (HSI), many DL-based methods focus on spectral feature extraction by expanding samples, exhibiting low model transferability, as well as high time consumption. To address these issues, we propose a novel spatial-spectral contrastive self-supervised learning-based HTD method with dual path networks (DPN-CSSTD). This method constructs a contrastive task using an HSI augmentation method and a DPN encoder on a large amount of unlabeled data, enabling the pretrained model with spatial-spectral discrimination ability. The DPN encoder uses the convolution neural network and skip connections to improve the spatial-spectral feature extraction. Additionally, the proposed method constructs a transfer learning model with the pretrained DPN encoder and a newly added detector to improve the pretrained model transferability and the time efficiency of target detection (TD) tasks. The transfer learning model is fine-tuned via a proposed fine-tuning strategy with a few selected samples to adapt to different TD tasks. Extensive experiments conducted on four challenging hyperspectral datasets demonstrate that the proposed method outperforms other state-of-the-art approaches.
engineering, electrical & electronic,imaging science & photographic technology,remote sensing,geochemistry & geophysics
What problem does this paper attempt to address?