Effectively learn how to learn: a novel few-shot learning with meta-gradient memory

Lin Hui,Yi-Cheng Chen,Yi g Chen
DOI: https://doi.org/10.1504/ijwgs.2024.137549
2024-01-01
International Journal of Web and Grid Services
Abstract:Recently, the importance of few-shot learning has tremendously grown due to its widespread applicability. Via few-shot learning, users can train their models with few data and maintain high generalisation ability. Meta-learning and continual learning models have demonstrated elegant performance in model development. However, unstable performance and catastrophic forgetting are still two fatal issues with regard to retaining the memory of knowledge about previous tasks when facing new tasks. In this paper, a novel method, enhanced model-agnostic meta-learning (EN-MAML), is proposed for blending the flexible adaptation characteristics of meta-learning and the stable performance of continual learning to tackle the above problems. Based on the proposed learning method, users can efficiently and effectively train the model in a stable manner with few data. Experiments show that when following the N-way K-shot experimental protocol, EN-MAML has higher accuracy, more stable performance and faster convergence than other state-of-the-art models on several real datasets.
computer science, information systems, software engineering
What problem does this paper attempt to address?