Abstract:Continual learning aims to rapidly and continually learn the current task from a sequence of tasks, using the knowledge obtained in the past, while performing well on prior tasks. A key challenge in this setting is the stability–plasticity dilemma existing in current and previous tasks, i.e., a high-stability network is weak to learn new knowledge in an effort to maintain previous knowledge. Correspondingly, a high-plasticity network can easily forget old tasks while dealing with well on the new task. Compared to other kinds of methods, the methods based on experience replay have shown great advantages to overcome catastrophic forgetting. One common limitation of this method is the data imbalance between the previous and current tasks, which would further aggravate forgetting. Moreover, how to effectively address the stability–plasticity dilemma in this setting is also an urgent problem to be solved. In this paper, we overcome these challenges by proposing a novel framework called Meta-learning update via Multi-scale Knowledge Distillation and Data Augmentation (MMKDDA). Specifically, we apply multi-scale knowledge distillation to grasp the evolution of long-range and short-range spatial relationships at different feature levels to alleviate the problem of data imbalance. Besides, our method mixes the samples from the episodic memory and current task in the online continual training procedure, thus alleviating the side influence due to the change of probability distribution. Moreover, we optimize our model via the meta-learning update by resorting to the number of tasks seen previously, which is helpful to keep a better balance between stability and plasticity. Finally, our extensive experiments on four benchmark datasets show the effectiveness of the proposed MMKDDA framework against other popular baselines, and ablation studies are also conducted to further analyze the role of each component in our framework.

Centroid Distance Distillation for Effective Rehearsal in Continual Learning

Memory Efficient Data-Free Distillation for Continual Learning.

Overcoming Domain Drift in Online Continual Learning

Distribution-Level Memory Recall for Continual Learning: Preserving Knowledge and Avoiding Confusion

Multi-Domain Multi-Task Rehearsal for Lifelong Learning

Online Distillation with Continual Learning for Cyclic Domain Shifts

Continual Learning via Manifold Expansion Replay

Contrastive Continual Learning with Importance Sampling and Prototype-Instance Relation Distillation

Contrastive Supervised Distillation for Continual Representation Learning

Enhancing Consistency and Mitigating Bias: A Data Replay Approach for Incremental Learning

Imbalance Mitigation for Continual Learning via Knowledge Decoupling and Dual Enhanced Contrastive Learning

DESIRE: Dynamic Knowledge Consolidation for Rehearsal-Free Continual Learning

Experience Consistency Distillation Continual Reinforcement Learning for Robotic Manipulation Tasks

Adversarially Diversified Rehearsal Memory (ADRM): Mitigating Memory Overfitting Challenge in Continual Learning

A Closer Look at Rehearsal-Free Continual Learning

Representation Space Maintenance: Against Forgetting in Continual Learning

Replay-enhanced Continual Reinforcement Learning

Prototype-Sample Relation Distillation: Towards Replay-Free Continual Learning

Double Confidence Calibration Focused Distillation for Task-Incremental Learning

Online Continual Learning Via the Meta-learning Update with Multi-scale Knowledge Distillation and Data Augmentation

M EMORY R EPLAY WITH D ATA C OMPRESSION FOR C ONTINUAL L EARNING