DiffClass: Diffusion-Based Class Incremental Learning

Zichong Meng,Jie Zhang,Changdi Yang,Zheng Zhan,Pu Zhao,Yanzhi Wang

2024-07-22

Abstract:Class Incremental Learning (CIL) is challenging due to catastrophic forgetting. On top of that, Exemplar-free Class Incremental Learning is even more challenging due to forbidden access to previous task data. Recent exemplar-free CIL methods attempt to mitigate catastrophic forgetting by synthesizing previous task data. However, they fail to overcome the catastrophic forgetting due to the inability to deal with the significant domain gap between real and synthetic data. To overcome these issues, we propose a novel exemplar-free CIL method. Our method adopts multi-distribution matching (MDM) diffusion models to unify quality and bridge domain gaps among all domains of training data. Moreover, our approach integrates selective synthetic image augmentation (SSIA) to expand the distribution of the training data, thereby improving the model's plasticity and reinforcing the performance of our method's ultimate component, multi-domain adaptation (MDA). With the proposed integrations, our method then reformulates exemplar-free CIL into a multi-domain adaptation problem to implicitly address the domain gap problem to enhance model stability during incremental training. Extensive experiments on benchmark class incremental datasets and settings demonstrate that our method excels previous exemplar-free CIL methods and achieves state-of-the-art performance.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The paper attempts to address the problem of overcoming catastrophic forgetting in exemplar-free Class Incremental Learning (CIL), particularly how to handle the significant domain gap between synthetic and real data when generating synthetic data to mitigate catastrophic forgetting. Existing methods suffer from performance degradation during long-term incremental learning due to their inability to effectively manage the domain gap between synthetic and real data. Therefore, the paper proposes a novel exemplar-free CIL method that reduces the domain gap and balances the stability and plasticity of the model through a Multi-Distribution Matching (MDM) diffusion model and Selective Synthetic Image Augmentation (SSIA) technique.

Specifically, the main contributions of the paper include:
1. **Proposing a new exemplar-free CIL method**: By adopting the MDM diffusion model and SSIA technique, it explicitly alleviates forgetting and balances stability and plasticity in an exemplar-free CIL setting.
2. **Innovatively redefining exemplar-free CIL as a task-agnostic Multi-Domain Adaptation (MDA) problem**: This pioneering step implicitly manages the domain gap during CIL training, better addressing the issue of catastrophic forgetting in exemplar-free CIL.
3. **Extensive experimental validation**: A large number of experiments conducted on the CIFAR100 and ImageNet100 datasets demonstrate that the method effectively mitigates catastrophic forgetting in various exemplar-free CIL settings, significantly outperforming existing methods.

Through these techniques and methods, the paper aims to provide a more effective solution to the key challenges in exemplar-free CIL, thereby improving the performance and stability of models in the incremental learning process.