Abstract:Few-shot learning, a challenging task in machine learning, aims to learn a classifier adaptable to recognize new, unseen classes with limited labeled examples. Meta-learning has emerged as a prominent framework for few-shot learning. Its training framework is originally a task-level learning method, such as Model-Agnostic Meta-Learning (MAML) and Prototypical Networks. And a recently proposed training paradigm called Meta-Baseline, which consists of sequential pre-training and meta-training stages, gains state-of-the-art performance. However, as a non-end-to-end training method, indicating the meta-training stage can only begin after the completion of pre-training, Meta-Baseline suffers from higher training cost and suboptimal performance due to the inherent conflicts of the two training stages. To address these limitations, we propose an end-to-end training paradigm consisting of two alternative loops. In the outer loop, we calculate cross entropy loss on the entire training set while updating only the final linear layer. In the inner loop, we employ the original meta-learning training mode to calculate the loss and incorporate gradients from the outer loss to guide the parameter updates. This training paradigm not only converges quickly but also outperforms existing baselines, indicating that information from the overall training set and the meta-learning training paradigm could mutually reinforce one another. Moreover, being model-agnostic, our framework achieves significant performance gains, surpassing the baseline systems by approximate 1%.

The Role of Global Labels in Few-Shot Classification and How to Infer Them

Robust Meta-Representation Learning via Global Label Inference and Classification

Feature Transformation for Few-Shot Learning

When Low Resource NLP Meets Unsupervised Language Model: Meta-Pretraining then Meta-Learning for Few-Shot Text Classification (Student Abstract)

Coarse-to-Fine Pseudo-Labeling Guided Meta-Learning for Few-Shot Classification

Revisiting Unsupervised Meta-Learning via the Characteristics of Few-Shot Tasks

Unsupervised meta-learning for few-shot learning

Meta Self-training for Few-shot Neural Sequence Labeling

Unraveling Meta-Learning: Understanding Feature Representations for Few-Shot Tasks

Pseudo-Labeling Based Practical Semi-Supervised Meta-Training for Few-Shot Learning

Few-Shot Directed Meta-Learning for Image Classification

Boosting Meta-Training with Base Class Information for Few-Shot Learning

Meta-Learning for Semi-Supervised Few-Shot Classification

Few-shot Learning with Meta Metric Learners

Meta-Information Guided Meta-Learning for Few-Shot Relation Classification.

Learning to Propagate Labels: Transductive Propagation Network for Few-shot Learning

Meta-Learning Adversarial Domain Adaptation Network for Few-Shot Text Classification.

Meta-Learning across Meta-Tasks for Few-Shot Learning

Semi-Supervised Meta-Learning Via Self-Training