Abstract:Personalized Federated Continual Learning (PFCL) is a new practical scenario that poses greater challenges in sharing and personalizing knowledge. PFCL not only relies on knowledge fusion for server aggregation at the global spatial-temporal perspective but also needs model improvement for each client according to the local requirements. Existing methods, whether in Personalized Federated Learning (PFL) or Federated Continual Learning (FCL), have overlooked the multi-granularity representation of knowledge, which can be utilized to overcome Spatial-Temporal Catastrophic Forgetting (STCF) and adopt generalized knowledge to itself by coarse-to-fine human cognitive mechanisms. Moreover, it allows more effectively to personalized shared knowledge, thus serving its own purpose. To this end, we propose a novel concept called multi-granularity prompt, i.e., coarse-grained global prompt acquired through the common model learning process, and fine-grained local prompt used to personalize the generalized representation. The former focuses on efficiently transferring shared global knowledge without spatial forgetting, and the latter emphasizes specific learning of personalized local knowledge to overcome temporal forgetting. In addition, we design a selective prompt fusion mechanism for aggregating knowledge of global prompts distilled from different clients. By the exclusive fusion of coarse-grained knowledge, we achieve the transmission and refinement of common knowledge among clients, further enhancing the performance of personalization. Extensive experiments demonstrate the effectiveness of the proposed method in addressing STCF as well as improving personalized performance. Our code now is available at <a class="link-external link-https" href="https://github.com/SkyOfBeginning/FedMGP" rel="external noopener nofollow">this https URL</a>.

Fed-CPrompt: Contrastive Prompt for Rehearsal-Free Federated Continual Learning

FedPrompt: Communication-Efficient and Privacy Preserving Prompt Tuning in Federated Learning

FPPL: An Efficient and Non-IID Robust Federated Continual Learning Framework

Hierarchical Prompts for Rehearsal-free Continual Learning

Consistent Prompting for Rehearsal-Free Continual Learning

KC-Prompt: End-To-End Knowledge-Complementary Prompting for Rehearsal-Free Continual Learning

POP: Prompt Of Prompts for Continual Learning

Learning to Prompt Your Domain for Vision-Language Models

Federated Class-Incremental Learning with Prompting

CP-Prompt: Composition-Based Cross-modal Prompting for Domain-Incremental Continual Learning

Mixture of Experts Made Personalized: Federated Prompt Learning for Vision-Language Models

Rehearsal-free Federated Domain-incremental Learning

Beyond Prompt Learning: Continual Adapter for Efficient Rehearsal-Free Continual Learning

Personalized Federated Continual Learning via Multi-granularity Prompt

Federated Learning from Vision-Language Foundation Models: Theoretical Analysis and Method

INCPrompt: Task-Aware incremental Prompting for Rehearsal-Free Class-incremental Learning

Convolutional Prompting meets Language Models for Continual Learning

PromptCL: Improving Event Representation via Prompt Template and Contrastive Learning

Consprompt: Exploiting Contrastive Samples for Few-Shot Prompt Learning

Adapter-Enhanced Semantic Prompting for Continual Learning