Abstract:Introduction: The meta-learning methods have been widely used to solve the problem of few-shot learning. Generally, meta-learners are trained on a variety of tasks and then generalized to novel tasks. Methods: However, existing meta-learning methods do not consider the relationship between meta-tasks and novel tasks during the meta-training period, so that initial models of the meta-learner provide less useful meta-knowledge for the novel tasks. This leads to a weak generalization ability on novel tasks. Meanwhile, different initial models contain different meta-knowledge, which leads to certain differences in the learning effect of novel tasks during the meta-testing period. Therefore, this article puts forward a meta-optimization method based on situational meta-task construction and cooperation of multiple initial models. First, during the meta-training period, a method of constructing situational meta-task is proposed, and the selected candidate task sets provide more effective meta-knowledge for novel tasks. Then, during the meta-testing period, an ensemble model method based on meta-optimization is proposed to minimize the loss of inter-model cooperation in prediction, so that multiple models cooperation can realize the learning of novel tasks. Results: The above-mentioned methods are applied to popular few-shot character datasets and image recognition datasets. Furthermore, the experiment results indicate that the proposed method achieves good effects in few-shot classification tasks. Discussion: In future work, we will extend our methods to provide more generalized and useful meta-knowledge to the model during the meta-training period when the novel few-shot tasks are completely invisible.

Meta-Learning with Heterogeneous Tasks

ST-MAML: A Stochastic-Task based Method for Task-Heterogeneous Meta-Learning

Hierarchical Meta-Learning with Hyper-Tasks for Few-Shot Learning

Rethinking Meta-Learning from a Learning Lens

Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learning

Set-based Meta-Interpolation for Few-Task Meta-Learning

Cross-Domain Heterogeneous Hyperspectral Image Classification Based on Meta-Learning with Task-Adaptive Loss Function.

Multimodal meta-learning through meta-learned task representations

Towards Well-Generalizing Meta-Learning Via Adversarial Task Augmentation

Hacking Task Confounder in Meta-Learning

Learning an Explicit Hyperparameter Prediction Function Conditioned on Tasks

MAML2: meta reinforcement learning via meta-learning for task categories

Meta-Learning across Meta-Tasks for Few-Shot Learning

The meta-learning method for the ensemble model based on situational meta-task

Learning an Explicit Hyperparameter Prediction Policy Conditioned on Tasks.

A Task-Aware Attention-Based Method for Improved Meta-Learning.

Clustered Task-Aware Meta-Learning by Learning From Learning Paths

Learning an Explicit Hyper-parameter Prediction Function Conditioned on Tasks

Metalearning with Very Few Samples Per Task

Meta-learning with an Adaptive Task Scheduler

Automated Relational Meta-learning