Abstract:Federated Class Continual Learning (FCCL) merges the challenges of distributed client learning with the need for seamless adaptation to new classes without forgetting old ones. The key challenge in FCCL is catastrophic forgetting, an issue that has been explored to some extent in Continual Learning (CL). However, due to privacy preservation requirements, some conventional methods, such as experience replay, are not directly applicable to FCCL. Existing FCCL methods mitigate forgetting by generating historical data through federated training of GANs or data-free knowledge distillation. However, these approaches often suffer from unstable training of generators or low-quality generated data, limiting their guidance for the model. To address this challenge, we propose a novel method of data replay based on diffusion models. Instead of training a diffusion model, we employ a pre-trained conditional diffusion model to reverse-engineer each class, searching the corresponding input conditions for each class within the model's input space, significantly reducing computational resources and time consumption while ensuring effective generation. Furthermore, we enhance the classifier's domain generalization ability on generated and real data through contrastive learning, indirectly improving the representational capability of generated data for real data. Comprehensive experiments demonstrate that our method significantly outperforms existing baselines. Code is available at <a class="link-external link-https" href="https://github.com/jinglin-liang/DDDR" rel="external noopener nofollow">this https URL</a>.

Joint Diffusion models in Continual Learning

Continual Learning of Diffusion Models with Generative Distillation

DDGR: Continual Learning with Deep Diffusion-based Generative Replay.

Using Diffusion Models as Generative Replay in Continual Federated Learning -- What will Happen?

GUIDE: Guidance-based Incremental Learning with Diffusion Models

Continual Offline Reinforcement Learning via Diffusion-based Dual Generative Replay

Diffusion-Driven Data Replay: A Novel Approach to Combat Forgetting in Federated Class Continual Learning

Continual Learning with Weight Interpolation

Continual Learning with Deep Generative Replay

Adaptive Progressive Continual Learning.

Continual Learning with Diffusion-based Generative Replay for Industrial Streaming Data

Learning to Remember: A Synaptic Plasticity Driven Framework for Continual Learning

DeepCollaboration: Collaborative Generative and Discriminative Models for Class Incremental Learning

Continual Diffuser (CoD): Mastering Continual Offline Reinforcement Learning with Experience Rehearsal

Learning Bayesian Sparse Networks with Full Experience Replay for Continual Learning

Looking Through the Past: Better Knowledge Retention for Generative Replay in Continual Learning

Generative Feature Replay with Orthogonal Weight Modification for Continual Learning

Diffusion Model Meets Non-Exemplar Class-Incremental Learning and Beyond

A Continual Learning Method for Reducing Class Interference Based on Replay

Class-Incremental Learning using Diffusion Model for Distillation and Replay

A Closer Look at Rehearsal-Free Continual Learning