Abstract:Recently, metric-based few-shot learning (FSL) methods have achieved good performance in the hyperspectral image (HSI) classification. However, existing methods suffer from two problems: over-reliance on image modality information leads to inaccurate prototype representation, where a prototype refers to the centroid of each class in the dataset, and the impact of redundant and noisy pixels on model discriminability is rarely considered. These problems result in insufficient discriminability of the model for the target domain. To address the above issues, we propose a cross-domain few-shot HSI classification framework with cross-modal alignment and supervised contrastive learning (CDFS-CASCL). It is well known that human visual learning greatly benefits from the input of various modal information such as vision, language, and video. Inspired by the way humans abstract image class concepts in language form and understand the essence of classes, we perform cross-modal alignment (CA) between similar image and text prototypes and use abstract text semantics to guide the model to learn semantic-related features with good generalization ability in images, so as to improve the accuracy of image prototypes representation of the prototypes. In addition, through supervised contrastive learning (SCL) based on neighborhood pixel mask in the target domain, the enhanced sample features belonging to the same class are closer, while the enhanced sample features belonging to different classes are pulled further, enabling the model to learn mask-robust discriminative feature representations, suppressing the negative impact of redundant and noisy pixels, and improving the model's discriminability. The experimental results demonstrate the superiority of the proposed CDFS-CASCL. The code is available at https://github.com/Li-ZK/CDFS-CASCL-2024.

Class Feature Sub-space for Few-Shot Classification

Feature Transformation for Few-Shot Learning

Balancing Feature Alignment and Uniformity for Few-Shot Classification.

Meta-feature Fusion for Few-Shot Time Series Classification

Few-Shot Class-Incremental Learning Via Feature Space Composition

CORE: CORrelation-Guided Feature Enhancement for Few-Shot Image Classification

TAFSSL: Task-Adaptive Feature Sub-Space Learning for few-shot classification

Cross-Domain Few-Shot Hyperspectral Image Classification With Cross-Modal Alignment and Supervised Contrastive Learning

Semi-Supervised Few-shot Image Classification Based on Subspace Learning

Feature fusion network based on few-shot fine-grained classification

Few-Shot Learning Based on Deep Learning for Image Classification

Few-Shot Image Classification Based on Swin Transformer + CSAM + EMD

Task-Related Saliency for Few-Shot Image Classification

Object-aware Long-short-range Spatial Alignment for Few-Shot Fine-Grained Image Classification

Exploring sample relationship for few-shot classification

TACDFSL: Task Adaptive Cross Domain Few-Shot Learning

What Makes for Effective Few-shot Point Cloud Classification?

Adaptive Semantic Consistency for Cross-domain Few-shot Classification

Cross-Level Distillation and Feature Denoising for Cross-Domain Few-Shot Classification

Disentangled Feature Representation for Few-shot Image Classification

Channel-spatial attention network for fewshot classification