Abstract:Modern artificial intelligence systems require class-incremental learning while suffering from catastrophic forgetting in many real-world applications. Due to the missing knowledge of past data, performance substantially degrades. Recent methods often used knowledge distillation and bias correction to avoid catastrophic forgetting caused by cognitive bias. However, since these methods mainly learn all samples indiscriminately, the model is hard to learn what it truly needs from the data stream to balance the new and old knowledge, leading to inevitable forgetting. Instead of considering each sample indiscriminately, the model should learn from its curious samples automatically. To tackle this problem, we propose a curiosity-driven class-incremental learning approach via adaptive sample selection for learning a more generalized model with fewer ineffective updates. Specifically, our method quantifies the model’s curiosity in each sample by two properties: uncertainty and novelty. Our model learns informative samples selectively during training utilizing the proposed uncertainty property, which benefits the classification decision boundary. In light of the imbalanced data, a novelty property is used to selectively optimize the model by employing dissimilar samples, endowing it with more robustness and less cognitive bias. Our method successfully reduces catastrophic forgetting and can be flexibly incorporated with other techniques. Extensive experiments and in-depth analysis on the CIFAR-100, Tiny-ImageNet and Caltech-101 datasets show that our approach outperforms competing methods for class-incremental learning in terms of preventing catastrophic forgetting.

Curiosity-Driven Class-Incremental Learning Via Adaptive Sample Selection

Class Incremental Learning with Important and Diverse Memory.

Class-Incremental Learning: A Survey

Memory Efficient Class-Incremental Learning for Image Classification

SRIL: Selective Regularization for Class-Incremental Learning

Fine-Grained Knowledge Selection and Restoration for Non-Exemplar Class Incremental Learning

A Robust and Anti-Forgettiable Model for Class-Incremental Learning

Class-Incremental Learning via Knowledge Amalgamation

Rethinking Class-Incremental Learning from a Dynamic Imbalanced Learning Perspective

A Strategy for an Uncompromising Incremental Learner

Class-Incremental Learning Based on Big Dataset Pre-Trained Models

Class Incremental Learning with Self-Supervised Pre-Training and Prototype Learning

CLUE: Consolidating Learned and Undergoing Experience in Domain-Incremental Classification

Maintaining Discrimination and Fairness in Class Incremental Learning

Uncertainty-Guided Semi-Supervised Few-Shot Class-Incremental Learning With Knowledge Distillation

Efficient Non-Exemplar Class-Incremental Learning with Retrospective Feature Synthesis

Large Scale Incremental Learning

Discrimination Correction and Balance for Class-Incremental Learning

Prototypes Sampling Mechanism for Class Incremental Learning

Class Incremental Learning with Deep Contrastive Learning and Attention Distillation

Defying Imbalanced Forgetting in Class Incremental Learning