Abstract:Modern artificial intelligence systems require class-incremental learning while suffering from catastrophic forgetting in many real-world applications. Due to the missing knowledge of past data, performance substantially degrades. Recent methods often used knowledge distillation and bias correction to avoid catastrophic forgetting caused by cognitive bias. However, since these methods mainly learn all samples indiscriminately, the model is hard to learn what it truly needs from the data stream to balance the new and old knowledge, leading to inevitable forgetting. Instead of considering each sample indiscriminately, the model should learn from its curious samples automatically. To tackle this problem, we propose a curiosity-driven class-incremental learning approach via adaptive sample selection for learning a more generalized model with fewer ineffective updates. Specifically, our method quantifies the model’s curiosity in each sample by two properties: uncertainty and novelty. Our model learns informative samples selectively during training utilizing the proposed uncertainty property, which benefits the classification decision boundary. In light of the imbalanced data, a novelty property is used to selectively optimize the model by employing dissimilar samples, endowing it with more robustness and less cognitive bias. Our method successfully reduces catastrophic forgetting and can be flexibly incorporated with other techniques. Extensive experiments and in-depth analysis on the CIFAR-100, Tiny-ImageNet and Caltech-101 datasets show that our approach outperforms competing methods for class-incremental learning in terms of preventing catastrophic forgetting.

Class-Incremental Learning Based on Big Dataset Pre-Trained Models

Class Incremental Learning with Self-Supervised Pre-Training and Prototype Learning

Large Scale Incremental Learning

Maintaining Discrimination and Fairness in Class Incremental Learning

Discrimination Correction and Balance for Class-Incremental Learning

Model Behavior Preserving for Class-Incremental Learning

Class-Incremental Learning: Survey and Performance Evaluation on Image Classification

An Efficient Replay for Class-Incremental Learning with Pre-trained Models

Incremental Learning Using Conditional Adversarial Networks

Class Incremental Learning with Deep Contrastive Learning and Attention Distillation

Class-Incremental Learning: A Survey

Incremental Learning Via Rate Reduction

An Efficient Strategy for Catastrophic Forgetting Reduction in Incremental Learning

Efficient Non-Exemplar Class-Incremental Learning with Retrospective Feature Synthesis

Curiosity-Driven Class-Incremental Learning Via Adaptive Sample Selection

Multi-granularity knowledge distillation and prototype consistency regularization for class-incremental learning

Incremental Classifier Learning with Generative Adversarial Networks

Prototypes Sampling Mechanism for Class Incremental Learning

Towards Class-incremental Object Detection with Nearest Mean of Exemplars

Adaptive knowledge transfer for class incremental learning