Abstract:Recently, metric-based few-shot learning (FSL) methods have achieved good performance in the hyperspectral image (HSI) classification. However, existing methods suffer from two problems: over-reliance on image modality information leads to inaccurate prototype representation, where a prototype refers to the centroid of each class in the dataset, and the impact of redundant and noisy pixels on model discriminability is rarely considered. These problems result in insufficient discriminability of the model for the target domain. To address the above issues, we propose a cross-domain few-shot HSI classification framework with cross-modal alignment and supervised contrastive learning (CDFS-CASCL). It is well known that human visual learning greatly benefits from the input of various modal information such as vision, language, and video. Inspired by the way humans abstract image class concepts in language form and understand the essence of classes, we perform cross-modal alignment (CA) between similar image and text prototypes and use abstract text semantics to guide the model to learn semantic-related features with good generalization ability in images, so as to improve the accuracy of image prototypes representation of the prototypes. In addition, through supervised contrastive learning (SCL) based on neighborhood pixel mask in the target domain, the enhanced sample features belonging to the same class are closer, while the enhanced sample features belonging to different classes are pulled further, enabling the model to learn mask-robust discriminative feature representations, suppressing the negative impact of redundant and noisy pixels, and improving the model's discriminability. The experimental results demonstrate the superiority of the proposed CDFS-CASCL. The code is available at https://github.com/Li-ZK/CDFS-CASCL-2024.

Enhancing Hyperspectral Image Classification: Leveraging Unsupervised Information With Guided Group Contrastive Learning

Purified Contrastive Learning With Global and Local Representation for Hyperspectral Image Classification

An Unsupervised Band Selection Method Via Contrastive Learning for Hyperspectral Images

ContrastNet: Unsupervised Feature Learning by Autoencoder and Prototypical Contrastive Learning for Hyperspectral Imagery Classification.

A Universal Knowledge Embedded Contrastive Learning Framework for Hyperspectral Image Classification

Aggregative and Contrastive Dual-View Graph Attention Network for Hyperspectral Image Classification

Hyperspectral Image Classification With Contrastive Graph Convolutional Network

A Hybrid Self-supervised Learning Framework For Hyperspectral Image Classification

Deep Contrastive Learning Network for Small-Sample Hyperspectral Image Classification

Deep Spatial-Spectral Subspace Clustering for Hyperspectral Images Based on Contrastive Learning

Supervised Contrastive Learning-Based Unsupervised Domain Adaptation for Hyperspectral Image Classification

Cross-Domain Few-Shot Hyperspectral Image Classification With Cross-Modal Alignment and Supervised Contrastive Learning

Advanced Global Prototypical Segmentation Framework for Few-Shot Hyperspectral Image Classification

Light-Weight Self-Supervised Contrastive Learning Network for Small Sample Hyperspectral Image Classification

A Hyperspectral Image Change Detection Framework With Self-Supervised Contrastive Learning Pretrained Model

Adversarial Domain Alignment With Contrastive Learning for Hyperspectral Image Classification

CTF-SSCL: CNN-Transformer for Few-Shot Hyperspectral Image Classification Assisted by Semisupervised Contrastive Learning

A Spectral-Spatial-Dependent Global Learning Framework for Insufficient and Imbalanced Hyperspectral Image Classification

DFL-LC: Deep Feature Learning With Label Consistencies for Hyperspectral Image Classification

Contrastive Graph Convolution Network With Skip Connections for Few-Shot Hyperspectral Image Classification

Nearest Neighbor-Based Contrastive Learning for Hyperspectral and LiDAR Data Classification