Abstract:Few-shot learning (FSL) aims to generate a classifier using limited labeled examples. Many existing works take the meta-learning approach, constructing a few-shot learner that can learn from few-shot examples to generate a classifier. Typically, the few-shot learner is constructed or meta-trained by sampling multiple few-shot tasks in turn and optimizing the few-shot learner's performance in generating classifiers for those tasks. The performance is measured by how well the resulting classifiers classify the test (i.e., query) examples of those tasks. In this paper, we point out two potential weaknesses of this approach. First, the sampled query examples may not provide sufficient supervision for meta-training the few-shot learner. Second, the effectiveness of meta-learning diminishes sharply with the increasing number of shots. To resolve these issues, we propose a novel meta-training objective for the few-shot learner, which is to encourage the few-shot learner to generate classifiers that perform like strong classifiers. Concretely, we associate each sampled few-shot task with a strong classifier, which is trained with ample labeled examples. The strong classifiers can be seen as the target classifiers that we hope the few-shot learner to generate given few-shot examples, and we use the strong classifiers to supervise the few-shot learner. We present an efficient way to construct the strong classifier, making our proposed objective an easily plug-and-play term to existing meta-learning based FSL methods. We validate our approach, LastShot, in combinations with many representative meta-learning methods. On several benchmark datasets, our approach leads to a notable improvement across a variety of tasks. More importantly, with our approach, meta-learning based FSL methods can outperform non-meta-learning based methods at different numbers of shots.

Secure Collaborative Few-Shot Learning

Privacy Enhancement for Cloud-Based Few-Shot Learning

Robust Few-shot Learning Without Using any Adversarial Samples

Decentralized federated meta‐learning framework for few‐shot multitask learning

Few-Shot Model Agnostic Federated Learning

Few-Shot Class-Incremental Learning with Non-IID Decentralized Data

Co-Learning for Few-Shot Learning

Federated Few-Shot Learning with Adversarial Learning

Fair Few-shot Learning with Auxiliary Sets

Few-Shot Learning with a Strong Teacher

Adaptive Federated Few-Shot Feature Learning with Prototype Rectification

Robust Compare Network for Few-Shot Learning

A Review of Few ‐ shot Learning

Few-Shot Classification of Aerial Scene Images via Meta-Learning

Defensive Few-shot Learning

Low-resolution Few-Shot Learning Via Multi-Space Knowledge Distillation

A Hybrid Approach with Optimization-Based and Metric-Based Meta-Learner for Few-Shot Learning

Few-shot Learning with Meta Metric Learners

Collaborative Global-Local Networks for Fine-Grained Few-shot Learning.

Learning to Affiliate: Mutual Centralized Learning for Few-shot Classification

Few-Shot Federated Learning: A Federated Learning Model for Small-Sample Scenarios