Abstract:Continual Learning (CL) aims to learn in non-stationary scenarios, progressively acquiring and maintaining knowledge from sequential tasks. Recent Prompt-based Continual Learning (PCL) has achieved remarkable performance with Pre-Trained Models (PTMs). These approaches grow a prompt sets pool by adding a new set of prompts when learning each new task (\emph{prompt learning}) and adopt a matching mechanism to select the correct set for each testing sample (\emph{prompt retrieval}). Previous studies focus on the latter stage by improving the matching mechanism to enhance Prompt Retrieval Accuracy (PRA). To promote cross-task knowledge facilitation and form an effective and efficient prompt sets pool, we propose a plug-in module in the former stage to \textbf{Learn Whether to Grow (LW2G)} based on the disparities between tasks. Specifically, a shared set of prompts is utilized when several tasks share certain commonalities, and a new set is added when there are significant differences between the new task and previous tasks. Inspired by Gradient Projection Continual Learning, our LW2G develops a metric called Hinder Forward Capability (HFC) to measure the hindrance imposed on learning new tasks by surgically modifying the original gradient onto the orthogonal complement of the old feature space. With HFC, an automated scheme Dynamic Growing Approach adaptively learns whether to grow with a dynamic threshold. Furthermore, we design a gradient-based constraint to ensure the consistency between the updating prompts and pre-trained knowledge, and a prompts weights reusing strategy to enhance forward transfer. Extensive experiments show the effectiveness of our method. The source codes are available at \url{<a class="link-external link-https" href="https://github.com/RAIAN08/LW2G" rel="external noopener nofollow">this https URL</a>}.

POP: Prompt Of Prompts for Continual Learning

Hierarchical Prompts for Rehearsal-free Continual Learning

Consistent Prompting for Rehearsal-Free Continual Learning

KC-Prompt: End-To-End Knowledge-Complementary Prompting for Rehearsal-Free Continual Learning

Prompt Customization for Continual Learning

RCS-Prompt: Learning Prompt to Rearrange Class Space for Prompt-based Continual Learning

Generating Prompts in Latent Space for Rehearsal-free Continual Learning

Progressive Prompts: Continual Learning for Language Models

Self-regulating Prompts: Foundational Model Adaptation without Forgetting

Convolutional Prompting meets Language Models for Continual Learning

CP-Prompt: Composition-Based Cross-modal Prompting for Domain-Incremental Continual Learning

OpenPrompt: an Open-source Framework for Prompt-learning

Semantic Residual Prompts for Continual Learning

Adapter-Enhanced Semantic Prompting for Continual Learning

MetaPrompting: Learning to Learn Better Prompts

LW2G: Learning Whether to Grow for Prompt-based Continual Learning

AdaPrompt: Adaptive Model Training for Prompt-based NLP

INCPrompt: Task-Aware incremental Prompting for Rehearsal-Free Class-incremental Learning

Fed-CPrompt: Contrastive Prompt for Rehearsal-Free Federated Continual Learning

Adaptive Multi-Modality Prompt Learning

Prompting Continual Person Search