Abstract:Few-shot learning enables rapid generalization from extremely limited training examples. While previous efforts have utilized meta-learning or data augmentation methods to mitigate the problem of data scarcity, such approaches may struggle to maintain robustness and generalize effectively due to overfitting and noise sensitivity. In this article, we propose a novel approach, the semi-supervised label correction method for few-shot learning (SSLC-FSL), which leverages the data distribution of readily available and easily obtainable unlabeled data. SSLC-FSL iteratively corrects the labels of testing samples with alternating steps of pseudo-labeling and sample selection. The objective of pseudo-labeling is to repurpose graph-based semi-supervised learning for joint prediction of the entire testing set. We then introduce a modulation selection network (MSN) to rank testing samples by learning with noisy labels. The training set is expanded by selecting confident pseudo-labeled samples. In the MSN, a modulation aggregation layer is designed to encode support class information into each testing sample, thereby highlighting target category features and mitigating the negative impact of incorrect labels. The iterative label correction process is repeated until all testing samples are recalled to the expanded support set. To boost the SSLC-FSL algorithm, we pretrain a feature extractor to produce general-purpose representations. Particularly, we investigate two types of auxiliary tasks and their collaborative learning to acquire transferable visual information via an end-to-end multitask learning model. Our SSLC-FSL outperforms current state-of-the-art methods in any shot and all data settings, with up to +27.74% on standard remote sensing benchmarks and +5.70% on standard natural scene benchmarks.

Task-Level Self-Supervision for Cross-Domain Few-Shot Learning

Task-Level Self-Supervision for Cross-Domain Few-Shot Learning

Self-taught cross-domain few-shot learning with weakly supervised object localization and task-decomposition

Task-aware Adaptive Learning for Cross-domain Few-shot Learning

Cross-domain self-supervised few-shot learning via multiple crops with teacher-student network

Cross-domain few-shot action recognition with unlabeled videos

How Well Do Self-Supervised Methods Perform in Cross-Domain Few-Shot Learning?

Three-Dimension Attention Mechanism and Self-Supervised Pretext Task for Augmenting Few-Shot Learning

Cross-Domain Few-Shot Classification Via Adversarial Task Augmentation

Multi-task Self-supervised Few-Shot Detection.

Reinforced Self-Supervised Training for Few-Shot Learning

Unsupervised Few-Shot Feature Learning Via Self-Supervised Training

Cross-Domain Few-Shot Graph Classification with a Reinforced Task Coordinator

Semi-Supervised Few-Shot Classification With Multitask Learning and Iterative Label Correction

Few-Shot Classification with Multi-task Self-supervised Learning.

Cross-Domain Few-Shot Segmentation via Iterative Support-Query Correspondence Mining

Boosting Supervision with Self-Supervision for Few-shot Learning

Boosting Few-Shot Learning with Task-Adaptive Multi-level Mixed Supervision.

Cross-domain Few-shot Learning with Task-specific Adapters

Learning to Teach and Learn for Semi-Supervised Few-Shot Image Classification.

Self-Supervised Tuning for Few-Shot Segmentation