Abstract:Hyperspectral target detection plays a pivotal role in various civil and military applications. Although recent advancements in deep learning have largely embraced supervised learning approaches, they often hindered by the limited availability of labeled data. Unsupervised learning, therefore, emerges as a promising alternative, yet its potential has not been fully realized in current methodologies. This article proposes an innovative unsupervised learning framework employing a momentum contrastive learning-based transformer network specifically tailored for hyperspectral target detection. The proposed approach innovatively combines transformer-based encoder and momentum encoder networks to enhance feature extraction capabilities, adeptly capturing both local spectral details and long-range spectral dependencies through the novel overlapping spectral patch embedding and a cross-token feedforward layer. This dual-encoder design significantly improves the model's ability to discern relevant spectral features amidst complex backgrounds. Through unsupervised momentum contrastive learning, a dynamically updated queue of negative sample features is utilized so that the model can demonstrate superior spectral discriminability. This is further bolstered by a unique background suppression mechanism leveraging nonlinear transformations of cosine similarity detection results, with two nonlinearly pull-up operations, significantly enhancing target detection sensitivity, where the nonlinearly operations are the exponential function with its normalization and the power function with its normalization, respectively. Comparative analysis against seven state-of-the-art hyperspectral target detection methods across four real hyperspectral images demonstrates the effectiveness of the proposed method for hyperspectral target detection, with an increase in detection accuracy and a competitive computational efficiency. An extensive ablation study further validates the critical components of the proposed framework, confirming its comprehensive capability and applicability in hyperspectral target detection scenarios.

Contrastive Learning Based on Transformer for Hyperspectral Image Classification

A Novel Transformer Network with a CNN-Enhanced Cross-Attention Mechanism for Hyperspectral Image Classification

Spatial-Spectral-Associative Contrastive Learning for Satellite Hyperspectral Image Classification with Transformers.

ContrastNet: Unsupervised Feature Learning by Autoencoder and Prototypical Contrastive Learning for Hyperspectral Imagery Classification.

Cross-Domain Hyperspectral Image Classification Based on Transformer

Hyperspectral Image Classification Using Hierarchical Spatial-Spectral Transformer

Hyperspectral Image Classification Using Group-Aware Hierarchical Transformer

An Unsupervised Momentum Contrastive Learning Based Transformer Network for Hyperspectral Target Detection

A Lightweight 1-D Convolution Augmented Transformer with Metric Learning for Hyperspectral Image Classification

A 3-D-Swin Transformer-Based Hierarchical Contrastive Learning Method for Hyperspectral Image Classification

Vision Transformer With Contrastive Learning for Hyperspectral Image Classification

Transformer-enhanced convolutional neural network with self-supervised learning for hyperspectral image classification

Hyperspectral Imagery Classification Based on Contrastive Learning

Spectral–Spatial Masked Transformer with Supervised and Contrastive Learning for Hyperspectral Image Classification

MSMT-LCL: Multiscale Spatial-Spectral Masked Transformer With Local Contrastive Learning for Hyperspectral Image Classification

Hierarchical Attention Transformer for Hyperspectral Image Classification

Deep Spectral Spatial Feature Enhancement Through Transformer for Hyperspectral Image Classification

Transformer-Based Masked Autoencoder with Contrastive Loss for Hyperspectral Image Classification.

A Hybrid Self-supervised Learning Framework For Hyperspectral Image Classification

A Lightweight Transformer Network for Hyperspectral Image Classification

Spectral–Spatial Feature Extraction for Hyperspectral Image Classification Using Enhanced Transformer with Large-Kernel Attention