Abstract:The problem of Rehearsal-Free Continual Learning (RFCL) aims to continually learn new knowledge while preventing forgetting of the old knowledge, without storing any old samples and prototypes. The latest methods leverage large-scale pre-trained models as the backbone and use key-query matching to generate trainable prompts to learn new knowledge. However, the domain gap between the pre-training dataset and the downstream datasets can easily lead to inaccuracies in key-query matching prompt selection when directly generating queries using the pre-trained model, which hampers learning new knowledge. Thus, in this paper, we propose a beyond prompt learning approach to the RFCL task, called Continual Adapter (C-ADA). It mainly comprises a parameter-extensible continual adapter layer (CAL) and a scaling and shifting (S&S) module in parallel with the pre-trained model. C-ADA flexibly extends specific weights in CAL to learn new knowledge for each task and freezes old weights to preserve prior knowledge, thereby avoiding matching errors and operational inefficiencies introduced by key-query matching. To reduce the gap, C-ADA employs an S&S module to transfer the feature space from pre-trained datasets to downstream datasets. Moreover, we propose an orthogonal loss to mitigate the interaction between old and new knowledge. Our approach achieves significantly improved performance and training speed, outperforming the current state-of-the-art (SOTA) method. Additionally, we conduct experiments on domain-incremental learning, surpassing the SOTA, and demonstrating the generality of our approach in different settings.

Continual Learning with Recursive Gradient Optimization

Progressive Learning without Forgetting

UniGrad-FS: Unified Gradient Projection with Flatter Sharpness for Continual Learning

Layerwise Optimization by Gradient Decomposition for Continual Learning

Orthogonal Gradient Descent for Continual Learning

Adaptive Progressive Continual Learning.

On the Convergence of Continual Learning with Adaptive Methods

Elastic Multi-Gradient Descent for Parallel Continual Learning

Two Complementary Perspectives to Continual Learning: Ask Not Only What to Optimize, But Also How

TRGP: Trust Region Gradient Projection for Continual Learning

Forget but Recall: Incremental Latent Rectification in Continual Learning

Restricted Orthogonal Gradient Projection for Continual Learning

Learning to Learn without Forgetting using Attention

Generative Feature Replay with Orthogonal Weight Modification for Continual Learning

Online Continual Learning with Declarative Memory

Beyond Prompt Learning: Continual Adapter for Efficient Rehearsal-Free Continual Learning

Automating Continual Learning

Iterative Relaxing Gradient Projection for Continual Learning

Bi-Objective Continual Learning: Learning 'new' While Consolidating 'Known'

Task Agnostic Continual Learning via Meta Learning

Efficient Meta-Learning for Continual Learning with Taylor Expansion Approximation