Abstract:With the advent and recent ubiquity of foundation models, continual learning (CL) has recently shifted from continual training from scratch to the continual adaptation of pretrained models, seeing particular success on rehearsal-free CL benchmarks (RFCL). To achieve this, most proposed methods adapt and restructure parameter-efficient finetuning techniques (PEFT) to suit the continual nature of the problem. Based most often on input-conditional query-mechanisms or regularizations on top of prompt- or adapter-based PEFT, these PEFT-style RFCL (P-RFCL) approaches report peak performances; often convincingly outperforming existing CL techniques. However, on the other end, critical studies have recently highlighted competitive results by training on just the first task or via simple non-parametric baselines. Consequently, questions arise about the relationship between methodological choices in P-RFCL and their reported high benchmark scores. In this work, we tackle these questions to better understand the true drivers behind strong P-RFCL performances, their placement w.r.t. recent first-task adaptation studies, and their relation to preceding CL standards such as EWC or SI. In particular, we show: (1) P-RFCL techniques relying on input-conditional query mechanisms work not because, but rather despite them by collapsing towards standard PEFT shortcut solutions. (2) Indeed, we show how most often, P-RFCL techniques can be matched by a simple and lightweight PEFT baseline. (3) Using this baseline, we identify the implicit bound on tunable parameters when deriving RFCL approaches from PEFT methods as a potential denominator behind P-RFCL efficacy. Finally, we (4) better disentangle continual versus first-task adaptation, and (5) motivate standard RFCL techniques s.a. EWC or SI in light of recent P-RFCL methods.

Beyond Prompt Learning: Continual Adapter for Efficient Rehearsal-Free Continual Learning

Adapter-Enhanced Semantic Prompting for Continual Learning

Adaptive Progressive Continual Learning.

A Unified Continual Learning Framework with General Parameter-Efficient Tuning

Adaptive Memory Replay for Continual Learning

Reflecting on the State of Rehearsal-free Continual Learning with Pretrained Models

FPPL: An Efficient and Non-IID Robust Federated Continual Learning Framework

In-context Continual Learning Assisted by an External Continual Learner

Mitigating Catastrophic Forgetting in Task-Incremental Continual Learning with Adaptive Classification Criterion

KC-Prompt: End-To-End Knowledge-Complementary Prompting for Rehearsal-Free Continual Learning

Consistent Prompting for Rehearsal-Free Continual Learning

CBA: Improving Online Continual Learning Via Continual Bias Adaptor

Adaptive Rentention & Correction for Continual Learning

AdaptCL: Adaptive Continual Learning for Tackling Heterogeneity in Sequential Datasets

Learning After Learning: Positive Backward Transfer in Continual Learning

Hierarchical Prompts for Rehearsal-free Continual Learning

Prior-Free Continual Learning with Unlabeled Data in the Wild

Don't Stop Learning: Towards Continual Learning for the CLIP Model

A rehearsal framework for computational efficiency in online continual learning

Convolutional Prompting meets Language Models for Continual Learning

Imbalance Mitigation for Continual Learning via Knowledge Decoupling and Dual Enhanced Contrastive Learning