Abstract:Continual learning (CL) aims at studying how to learn new knowledge continuously from data streams without catastrophically forgetting the previous knowledge. One of the key problems is catastrophic forgetting, that is, the performance of the model on previous tasks declines significantly after learning the subsequent task. Several studies addressed it by replaying samples stored in the buffer when training new tasks. However, the data imbalance between old and new task samples results in two serious problems: information suppression and weak feature discriminability. The former refers to the information in the sufficient new task samples suppressing that in the old task samples, which is harmful to maintaining the knowledge since the biased output worsens the consistency of the same sample's output at different moments. The latter refers to the feature representation being biased to the new task, which lacks discrimination to distinguish both old and new tasks. To this end, we build an imbalance mitigation for CL (IMCL) framework that incorporates a decoupled knowledge distillation (DKD) approach and a dual enhanced contrastive learning (DECL) approach to tackle both problems. Specifically, the DKD approach alleviates the suppression of the new task on the old tasks by decoupling the model output probability during the replay stage, which better maintains the knowledge of old tasks. The DECL approach enhances both low-and high-level features and fuses the enhanced features to construct contrastive loss to effectively distinguish different tasks. Extensive experiments on three popular datasets show that our method achieves promising performance under task incremental learning (Task-IL), class incremental learning (Class-IL), and domain incremental learning (Domain-IL) settings.

Continual Learning in the Presence of Spurious Correlation

CBA: Improving Online Continual Learning Via Continual Bias Adaptor

Imbalance Mitigation for Continual Learning via Knowledge Decoupling and Dual Enhanced Contrastive Learning

Counterexample Contrastive Learning for Spurious Correlation Elimination

Dual-CBA: Improving Online Continual Learning via Dual Continual Bias Adaptors from a Bi-level Optimization Perspective

On the Convergence of Continual Learning with Adaptive Methods

Learning After Learning: Positive Backward Transfer in Continual Learning

Beyond Not-Forgetting: Continual Learning with Backward Knowledge Transfer

Dealing with Cross-Task Class Discrimination in Online Continual Learning

CoSCL: Cooperation of Small Continual Learners is Stronger than a Big One

BiasPruner: Debiased Continual Learning for Medical Image Classification

CafeBoost: Causal Feature Boost to Eliminate Task-Induced Bias for Class Incremental Learning

Improving Plasticity in Online Continual Learning via Collaborative Learning

Bio-inspired, task-free continual learning through activity regularization

Regularizing Second-Order Influences for Continual Learning

New Insights on Relieving Task-Recency Bias for Online Class Incremental Learning

Optimizing Spca-based Continual Learning: A Theoretical Approach.

Continual Learning on a Data Diet

Hierarchical Correlations Replay for Continual Learning

Continual Feature Selection: Spurious Features in Continual Learning

Achieving a Better Stability-Plasticity Trade-off via Auxiliary Networks in Continual Learning