Abstract:Continual Learning (CL) aims to incrementally update a trained model on new tasks without forgetting the acquired knowledge of old ones. Existing CL methods usually reduce forgetting with task priors, \ie using task identity or a subset of previously seen samples for model training. However, these methods would be infeasible when such priors are unknown in real-world applications. To address this fundamental but seldom-studied problem, we propose a Prior-Free Continual Learning (PFCL) method, which learns new tasks without knowing the task identity or any previous data. First, based on a fixed single-head architecture, we eliminate the need for task identity to select the task-specific output head. Second, we employ a regularization-based strategy for consistent predictions between the new and old models, avoiding revisiting previous samples. However, using this strategy alone often performs poorly in class-incremental scenarios, particularly for a long sequence of tasks. By analyzing the effectiveness and limitations of conventional regularization-based methods, we propose enhancing model consistency with an auxiliary unlabeled dataset additionally. Moreover, since some auxiliary data may degrade the performance, we further develop a reliable sample selection strategy to obtain consistent performance improvement. Extensive experiments on multiple image classification benchmark datasets show that our PFCL method significantly mitigates forgetting in all three learning scenarios. Furthermore, when compared to the most recent rehearsal-based methods that replay a limited number of previous samples, PFCL achieves competitive accuracy. Our code is available at: <a class="link-external link-https" href="https://github.com/visiontao/pfcl" rel="external noopener nofollow">this https URL</a>

Continual Learning by Using Information of Each Class Holistically.

Progressive Learning without Forgetting

InfoCL: Alleviating Catastrophic Forgetting in Continual Text Classification from an Information Theoretic Perspective

Mitigating Catastrophic Forgetting in Task-Incremental Continual Learning with Adaptive Classification Criterion

Adaptive Progressive Continual Learning.

Prior-Free Continual Learning with Unlabeled Data in the Wild

TARGET: Federated Class-Continual Learning Via Exemplar-Free Distillation

Imbalance Mitigation for Continual Learning via Knowledge Decoupling and Dual Enhanced Contrastive Learning

PNSP: Overcoming Catastrophic Forgetting Using Primary Null Space Projection in Continual Learning

A Theoretical Study on Solving Continual Learning

A Unified and General Framework for Continual Learning

Enhancing Visual Continual Learning with Language-Guided Supervision

Realistic Continual Learning Approach using Pre-trained Models

Bi-Objective Continual Learning: Learning 'new' While Consolidating 'Known'

Dealing with Cross-Task Class Discrimination in Online Continual Learning

Learning Invariant Features for Online Continual Learning

Don't Stop Learning: Towards Continual Learning for the CLIP Model

Continual Learning Using a Kernel-Based Method Over Foundation Models

Achieving Forgetting Prevention and Knowledge Transfer in Continual Learning

Heterogeneous Continual Learning

Sub-network Discovery and Soft-masking for Continual Learning of Mixed Tasks