Abstract:Meta-learning has been proposed as a framework to address the challenging few-shot learning setting. The key idea is to leverage a large number of similar few-shot tasks in order to learn how to adapt a base-learner to a new task for which only a few labeled samples are available. As deep neural networks (DNNs) tend to overfit using a few samples only, typical meta-learning models use shallow neural networks, thus limiting its effectiveness. In order to achieve top performance, some recent works tried to use the DNNs pre-trained on large-scale datasets but mostly in straight-forward manners, e.g., (1) taking their weights as a warm start of meta-training, and (2) freezing their convolutional layers as the feature extractor of base-learners. In this paper, we propose a novel approach called meta-transfer learning (MTL) , which learns to transfer the weights of a deep NN for few-shot learning tasks. Specifically, meta refers to training multiple tasks, and transfer is achieved by learning scaling and shifting functions of DNN weights (and biases) for each task. To further boost the learning efficiency of MTL, we introduce the hard task (HT) meta-batch scheme as an effective learning curriculum of few-shot classification tasks. We conduct experiments for five-class few-shot classification tasks on three challenging benchmarks, mini ImageNet, tiered ImageNet, and Fewshot-CIFAR100 (FC100), in both supervised and semi-supervised settings. Extensive comparisons to related works validate that our MTL approach trained with the proposed HT meta-batch scheme achieves top performance. An ablation study also shows that both components contribute to fast convergence and high accuracy.

Learning transferable features in meta-learning for few-shot text classification

Meta-Learning Adversarial Domain Adaptation Network for Few-Shot Text Classification.

Adaptive Meta-learner via Gradient Similarity for Few-shot Text Classification

Feature Transformation for Few-Shot Learning

Improve Meta-learning for Few-Shot Text Classification with All You Can Acquire from the Tasks

When Low Resource NLP Meets Unsupervised Language Model: Meta-Pretraining then Meta-Learning for Few-Shot Text Classification (Student Abstract)

MEDA: Meta-Learning with Data Augmentation for Few-Shot Text Classification.

Revisiting Unsupervised Meta-Learning via the Characteristics of Few-Shot Tasks

A Joint Optimization Framework of the Embedding Model and Classifier for Meta-Learning

Meta-learning Siamese Network for Few-Shot Text Classification.

Few-Shot Classification Based on Sparse Dictionary Meta-Learning

Meta-Transfer Learning Through Hard Tasks

Meta transfer evidence deep learning for trustworthy few-shot classification

MGIMN: Multi-Grained Interactive Matching Network for Few-shot Text Classification

MetaDelta: A Meta-Learning System for Few-shot Image Classification

Learning to Adapt Category Consistent Meta-Feature of CLIP for Few-Shot Classification

Transductive Episodic-Wise Adaptive Metric for Few-Shot Learning

Gradient-Based Meta-Learning Using Uncertainty to Weigh Loss for Few-Shot Learning

Learning to Generalize Unseen Domains via Multi-Source Meta Learning for Text Classification

Meta-learning of feature distribution alignment for enhanced feature sharing