Abstract:Non-Exemplar Class Incremental Learning (NECIL) involves learning a classification model on a sequence of data without access to exemplars from previously encountered old classes. Such a stringent constraint always leads to catastrophic forgetting of the learned knowledge. Currently, existing methods either employ knowledge distillation techniques or preserved class prototypes to sustain prior knowledge. However, two critical issues still persist. On the one hand, as the model is continually updated, the preserved prototypes of old classes will inevitably derive from the suitable location in the feature space of the new model. On the other hand, due to the lack of exemplars, the features of new classes will take the place of similar old classes which breaks the classification boundary. To address these challenges, we propose a Feature Calibration and Separation (FCS) method for NECIL. Our approach comprises a Feature Calibration Network (FCN) that adapts prototypes of old classes to the new model via optimal transport learning, approximating the drift of prototypes caused by model evolution. Additionally, we also propose a Prototype-Involved Contrastive Loss (PIC) that enhances feature separation among different classes. Specifically, to mitigate the boundary distortion arising from the interplay of classes from different learning stages, prototypes are involved in pushing the feature of new classes away from the old classes. Extensive experiments on three datasets with different settings have demonstrated the superiority of our FCS method against the state-of-the-art class incremental learning approaches. Code is available at https://github.com/zhoujiahuan1991/CVPR2024-FCS.

Diffusion Model Meets Non-Exemplar Class-Incremental Learning and Beyond

Efficient Non-Exemplar Class-Incremental Learning with Retrospective Feature Synthesis

DiffClass: Diffusion-Based Class Incremental Learning

Autonomous Generative Feature Replay for Non-Exemplar Class-Incremental Learning

Generative Feature Replay For Class-Incremental Learning

Diffusion-Driven Data Replay: A Novel Approach to Combat Forgetting in Federated Class Continual Learning

FRMM: Feature Reprojection for Exemplar-Free Class-Incremental Learning

Future-Proofing Class Incremental Learning

Hybrid Memory Replay: Blending Real and Distilled Data for Class Incremental Learning

Prompt-Based Exemplar Super-Compression and Regeneration for Class-Incremental Learning

Class-Incremental Learning using Diffusion Model for Distillation and Replay

Non-Exemplar Class-Incremental Learning Via Adaptive Old Class Reconstruction

CEAT: Continual Expansion and Absorption Transformer for Non-Exemplar Class-Incremental Learning

Prototype Reminiscence and Augmented Asymmetric Knowledge Aggregation for Non-Exemplar Class-Incremental Learning

Dual Memory Model for Experience-Once Task-Incremental Lifelong Learning.

DDGR: Continual Learning with Deep Diffusion-based Generative Replay.

An Efficient Replay for Class-Incremental Learning with Pre-trained Models

FCS: Feature Calibration and Separation for Non-Exemplar Class Incremental Learning

3EF: Class-Incremental Learning via Efficient Energy-Based Expansion and Fusion

Few-Shot Class-Incremental Learning via Entropy-Regularized Data-Free Replay

A Continual Learning Method for Reducing Class Interference Based on Replay