Abstract:Continual learning algorithms which keep the parameters of new tasks close to that of previous tasks, are popular in preventing catastrophic forgetting in sequential task learning settings. However, 1) the performance for the new continual learner will be degraded without distinguishing the contributions of previously learned tasks; 2) the computational cost will be greatly increased with the number of tasks, since most existing algorithms need to regularize all previous tasks when learning new tasks. To address the above challenges, we propose a self-paced Weight Consolidation (spWC) framework to attain robust continual learning via evaluating the discriminative contributions of previous tasks. To be specific, we develop a self-paced regularization to reflect the priorities of past tasks via measuring difficulty based on key performance indicator (i.e., accuracy). When encountering a new task, all previous tasks are sorted from "difficult" to "easy" based on the priorities. Then the parameters of the new continual learner will be learned via selectively maintaining the knowledge amongst more difficult past tasks, which could well overcome catastrophic forgetting with less computational cost. We adopt an alternative convex search to iteratively update the model parameters and priority weights in the bi-convex formulation. The proposed spWC framework is plug-and-play, which is applicable to most continual learning algorithms (e.g., EWC, MAS and RCIL) in different directions (e.g., classification and segmentation). Experimental results on several public benchmark datasets demonstrate that our proposed framework can effectively improve performance when compared with other popular continual learning algorithms.

RTRA: Rapid Training of Regularization-based Approaches in Continual Learning

Progressive Learning without Forgetting

Self-paced Weight Consolidation for Continual Learning

Continual Learning in Human Activity Recognition: an Empirical Analysis of Regularization

Optimization and Generalization of Regularization-Based Continual Learning: a Loss Approximation Viewpoint

Slowing Down Forgetting in Continual Learning

Regularization Shortcomings for Continual Learning

Overcoming Catastrophic Forgetting with Classifier Expander.

IMEX-Reg: Implicit-Explicit Regularization in the Function Space for Continual Learning

Improving Data-aware and Parameter-aware Robustness for Continual Learning

Can Continual Learning Improve Long-Tailed Recognition? Toward a Unified Framework

Overcoming Catastrophic Forgetting in Continual Learning by Exploring Eigenvalues of Hessian Matrix.

On the Convergence of Continual Learning with Adaptive Methods

Mitigating Catastrophic Forgetting in Task-Incremental Continual Learning with Adaptive Classification Criterion

Continual Learning with Recursive Gradient Optimization

TRGP: Trust Region Gradient Projection for Continual Learning

Learning After Learning: Positive Backward Transfer in Continual Learning

Realistic Continual Learning Approach using Pre-trained Models

Addressing Loss of Plasticity and Catastrophic Forgetting in Continual Learning

Understanding Catastrophic Forgetting and Remembering in Continual Learning with Optimal Relevance Mapping

Adaptive Progressive Continual Learning.