Abstract:Meta-learning has been widely applied to solving few-shot reinforcement learning problems, where we hope to obtain an agent that can learn quickly in a new task. However, these algorithms often ignore some isolated tasks in pursuit of the average performance, which may result in negative adaptation in these isolated tasks, and they usually need sufficient learning in a stationary task distribution. In this paper, our algorithm presents a hierarchical framework of double meta-learning, and the whole framework includes classification, meta-learning, and re-adaptation. Firstly, in the classification process, we classify tasks into several task subsets, considered as some categories of tasks, by learned parameters of each task, which can separate out some isolated tasks thereafter. Secondly, in the meta-learning process, we learn category parameters in all subsets via meta-learning. Simultaneously, based on the gradient of each category parameter in each subset, we use meta-learning again to learn a new meta-parameter related to the whole task set, which can be used as an initial parameter for the new task. Finally, in the re-adaption process, we adapt the parameter of the new task with two steps, by the meta-parameter and the appropriate category parameter successively. Experimentally, we demonstrate our algorithm prevents the agent from negative adaptation without losing the average performance for the whole task set. Additionally, our algorithm presents a more rapid adaptation process within re-adaptation. Moreover, we show the good performance of our algorithm with fewer samples as the agent is exposed to an online meta-learning setting.

MAC: a meta-learning approach for feature learning and recombination

To Learn Effective Features: Understanding the Task-Specific Adaptation of MAML

Adaptive Compositional Continual Meta-Learning.

Model-Agnostic Learning to Meta-Learn

Meta-Learning with Neural Tangent Kernels

Connection-Adaptive Meta-Learning

EW-CACTUs-MAML: A Robust Metalearning System for Rapid Classification on a Large Number of Tasks

MAML2: meta reinforcement learning via meta-learning for task categories

Scalable Multi-Modal Continual Meta-Learning

Fast Adaptation with Kernel and Gradient based Meta Leaning

MetaComp: Learning to Adapt for Online Depth Completion

Dual Meta Calibration Mix for Improving Generalization in Meta-Learning

Learning to Learn by Jointly Optimizing Neural Architecture and Weights

BI-MAML: Balanced Incremental Approach for Meta Learning

Understanding Transfer Learning and Gradient-Based Meta-Learning Techniques

When MAML Can Adapt Fast and How to Assist When It Cannot

A Task-Aware Attention-Based Method for Improved Meta-Learning.

Optimizing Reusable Knowledge for Continual Learning via Metalearning

Task Similarity Aware Meta Learning - Theory-Inspired Improvement on MAML.

A Meta Understanding of Meta-Learning