Abstract:Recently, metric-based few-shot learning (FSL) methods have achieved good performance in the hyperspectral image (HSI) classification. However, existing methods suffer from two problems: over-reliance on image modality information leads to inaccurate prototype representation, where a prototype refers to the centroid of each class in the dataset, and the impact of redundant and noisy pixels on model discriminability is rarely considered. These problems result in insufficient discriminability of the model for the target domain. To address the above issues, we propose a cross-domain few-shot HSI classification framework with cross-modal alignment and supervised contrastive learning (CDFS-CASCL). It is well known that human visual learning greatly benefits from the input of various modal information such as vision, language, and video. Inspired by the way humans abstract image class concepts in language form and understand the essence of classes, we perform cross-modal alignment (CA) between similar image and text prototypes and use abstract text semantics to guide the model to learn semantic-related features with good generalization ability in images, so as to improve the accuracy of image prototypes representation of the prototypes. In addition, through supervised contrastive learning (SCL) based on neighborhood pixel mask in the target domain, the enhanced sample features belonging to the same class are closer, while the enhanced sample features belonging to different classes are pulled further, enabling the model to learn mask-robust discriminative feature representations, suppressing the negative impact of redundant and noisy pixels, and improving the model's discriminability. The experimental results demonstrate the superiority of the proposed CDFS-CASCL. The code is available at https://github.com/Li-ZK/CDFS-CASCL-2024.

Progressive Contrastive Learning Based on Noisy Negatives Cleaning for Hyperspectral Image Classification

Purified Contrastive Learning With Global and Local Representation for Hyperspectral Image Classification

ProGCL: Rethinking Hard Negative Mining in Graph Contrastive Learning

Debiased Graph Contrastive Learning.

Hierarchical Semi-supervised Contrastive Learning for Contamination-Resistant Anomaly Detection

ContrastNet: Unsupervised Feature Learning by Autoencoder and Prototypical Contrastive Learning for Hyperspectral Imagery Classification.

Enhancing Hyperspectral Image Classification: Leveraging Unsupervised Information With Guided Group Contrastive Learning

Heterogeneous Network Based Contrastive Learning Method for PolSAR Land Cover Classification

Contrastive learning–based structure preserving projection for hyperspectral images

Deep Contrastive Learning Network for Small-Sample Hyperspectral Image Classification

A Hyperspectral Image Change Detection Framework With Self-Supervised Contrastive Learning Pretrained Model

Negative Samples Mining Matters: Reconsidering Hyperspectral Image Classification with Contrastive Learning

Enhancing Hyperspectral Image Prediction with Contrastive Learning in Low-Label Regime

Two-Stream Networks for Contrastive Learning in Hyperspectral Image Classification

Cross-Domain Few-Shot Hyperspectral Image Classification With Cross-Modal Alignment and Supervised Contrastive Learning

Mask-Enhanced Contrastive Learning for Hyperspectral Image Classification

Deep Spatial-Spectral Subspace Clustering for Hyperspectral Images Based on Contrastive Learning

HAPiCLR: heuristic attention pixel-level contrastive loss representation learning for self-supervised pretraining

Synthetic Hard Negative Samples for Contrastive Learning

A Universal Knowledge Embedded Contrastive Learning Framework for Hyperspectral Image Classification

Pixel-Superpixel Contrastive Learning and Pseudo-Label Correction for Hyperspectral Image Clustering