Abstract:Continual learning requires to overcome catastrophic forgetting when training a single model on a sequence of tasks. Recent top-performing approaches are prompt-based methods that utilize a set of learnable parameters (i.e., prompts) to encode task knowledge, from which appropriate ones are selected to guide the fixed pre-trained model in generating features tailored to a certain task. However, existing methods rely on predicting prompt identities for prompt selection, where the identity prediction process cannot be optimized with task loss. This limitation leads to sub-optimal prompt selection and inadequate adaptation of pre-trained features for a specific task. Previous efforts have tried to address this by directly generating prompts from input queries instead of selecting from a set of candidates. However, these prompts are continuous, which lack sufficient abstraction for task knowledge representation, making them less effective for continual learning. To address these challenges, we propose VQ-Prompt, a prompt-based continual learning method that incorporates Vector Quantization (VQ) into end-to-end training of a set of discrete prompts. In this way, VQ-Prompt can optimize the prompt selection process with task loss and meanwhile achieve effective abstraction of task knowledge for continual learning. Extensive experiments show that VQ-Prompt outperforms state-of-the-art continual learning methods across a variety of benchmarks under the challenging class-incremental setting. The code is available at \href{<a class="link-external link-https" href="https://github.com/jiaolifengmi/VQ-Prompt" rel="external noopener nofollow">this https URL</a>}{this https URL}.

KC-Prompt: End-To-End Knowledge-Complementary Prompting for Rehearsal-Free Continual Learning

Hierarchical Prompts for Rehearsal-free Continual Learning

INCPrompt: Task-Aware incremental Prompting for Rehearsal-Free Class-incremental Learning

RCS-Prompt: Learning Prompt to Rearrange Class Space for Prompt-based Continual Learning

Consistent Prompting for Rehearsal-Free Continual Learning

Evolving Parameterized Prompt Memory for Continual Learning

Decoupling Knowledge from Memorization: Retrieval-augmented Prompt Learning

Mixture of Experts Meets Prompt-Based Continual Learning

Vector Quantization Prompting for Continual Learning

When Prompt-based Incremental Learning Does Not Meet Strong Pretraining

POP: Prompt Of Prompts for Continual Learning

Prompting to Prompt for Rehearsal-Free Class Incremental Learning.

Hierarchical Decomposition of Prompt-Based Continual Learning: Rethinking Obscured Sub-optimality

S-Prompts Learning with Pre-trained Transformers: An Occam's Razor for Domain Incremental Learning

CP-Prompt: Composition-Based Cross-modal Prompting for Domain-Incremental Continual Learning

Prompt Customization for Continual Learning

Convolutional Prompting meets Language Models for Continual Learning

Progressive Prompts: Continual Learning for Language Models

Adaptive Prompting for Continual Relation Extraction: A Within-Task Variance Perspective