Abstract:Considering the data collection and labeling cost in real-world applications, training a model with limited examples is an essential problem in machine learning, visual recognition, etc. Directly training a model on such few-shot learning (FSL) tasks falls into the over-fitting dilemma, which would turn to an effective task-level inductive bias as a key supervision. By treating the few-shot task as an entirety, extracting task-level pattern, and learning a task-agnostic model initialization, the model-agnostic meta-learning (MAML) framework enables the applications of various models on the FSL tasks. Given a training set with a few examples, MAML optimizes a model via fixed gradient descent steps from an initial point chosen beforehand. Although this general framework possesses empirically satisfactory results, its initialization neglects the task-specific characteristics and aggravates the computational burden as well. In this manuscript, we propose our AdaptiVely InitiAlized Task OptimizeR ( Aviator ) approach for few-shot learning, which incorporates task context into the determination of the model initialization. This task-specific initialization facilitates the model optimization process so that it obtains high-quality model solutions efficiently. To this end, we decouple the model and apply a set transformation over the training set to determine the initial top-layer classifier. Re-parameterization of the first-order gradient descent approximation promotes the gradient back-propagation. Experiments on synthetic and benchmark data sets validate that our Aviator approach achieves the state-of-the-art performance, and visualization results demonstrate the task-adaptive features of our proposed Aviator method.

Meta-Learning with Task-Adaptive Loss Function for Few-Shot Learning

Task-Agnostic Meta-Learning for Few-shot Learning

Meta-Learning Adversarial Domain Adaptation Network for Few-Shot Text Classification.

Task-based Focal Loss for Adversarially Robust Meta-Learning.

Gradient-Based Meta-Learning Using Uncertainty to Weigh Loss for Few-Shot Learning

Gradient-Based Meta-Learning Using Adaptive Multiple Loss Weighting and Homoscedastic Uncertainty

Learning to Learn Adaptive Classifier–Predictor for Few-Shot Learning

Model-agnostic Multi-Stage Loss Optimization Meta Learning

Adaptive Meta-learner via Gradient Similarity for Few-shot Text Classification

Fast Adaptation with Kernel and Gradient based Meta Leaning

Meta-Learning across Meta-Tasks for Few-Shot Learning

Few-shot Learning with Adaptively Initialized Task Optimizer: a Practical Meta-Learning Approach

Task Similarity Aware Meta Learning - Theory-Inspired Improvement on MAML.

Improving Meta-Learning Model Via Meta-Contrastive Loss

Revisiting Unsupervised Meta-Learning via the Characteristics of Few-Shot Tasks

Task Attended Meta-Learning for Few-Shot Learning

A Nested Bi-level Optimization Framework for Robust Few Shot Learning

MetaModulation: Learning Variational Feature Hierarchies for Few-Shot Learning with Fewer Tasks

Meta-SGD: Learning to Learn Quickly for Few-Shot Learning

Multimodal meta-learning through meta-learned task representations