Abstract:Modern deep learning approaches have achieved great success in many vision applications by training a model using all available task-specific data. However, there are two major obstacles making it challenging to implement for real life applications: (1) Learning new classes makes the trained model quickly forget old classes knowledge, which is referred to as catastrophic forgetting. (2) As new observations of old classes come sequentially over time, the distribution may change in unforeseen way, making the performance degrade dramatically on future data, which is referred to as concept drift. Current state-of-the-art incremental learning methods require a long time to train the model whenever new classes are added and none of them takes into consideration the new observations of old classes. In this paper, we propose an incremental learning framework that can work in the challenging online learning scenario and handle both new classes data and new observations of old classes. We address problem (1) in online mode by introducing a modified cross-distillation loss together with a two-step learning technique. Our method outperforms the results obtained from current state-of-the-art offline incremental learning methods on the CIFAR-100 and ImageNet-1000 (ILSVRC 2012) datasets under the same experiment protocol but in online scenario. We also provide a simple yet effective method to mitigate problem (2) by updating exemplar set using the feature of each new observation of old classes and demonstrate a real life application of online food image classification based on our complete framework using the Food-101 dataset.

Class incremental learning with self-supervised pre-training and prototype learning

Class Incremental Learning with Self-Supervised Pre-Training and Prototype Learning

Prototypes Sampling Mechanism for Class Incremental Learning

Multi-granularity knowledge distillation and prototype consistency regularization for class-incremental learning

Incremental Learning In Online Scenario

Prototype Representation Expansion in Incremental Learning

More Task-Balanced Class-Incremental Learning

Multivariate Prototype Representation for Domain-Generalized Incremental Learning

Class-Incremental Learning Based on Big Dataset Pre-Trained Models

Efficient Non-Exemplar Class-Incremental Learning with Retrospective Feature Synthesis

Non-Exemplar Online Class-incremental Continual Learning via Dual-prototype Self-augment and Refinement

Maintaining Discrimination and Fairness in Class Incremental Learning

Towards Class-incremental Object Detection with Nearest Mean of Exemplars

Incremental Learning Using Conditional Adversarial Networks

Rethinking Class-Incremental Learning from a Dynamic Imbalanced Learning Perspective

Hybrid Rotation Self-Supervision and Feature Space Normalization for Class Incremental Learning

Adaptive knowledge transfer for class incremental learning

Class-Incremental Semantic Segmentation of Aerial Images Via Pixel-Level Feature Generation and Task-Wise Distillation

Self-Supervised Learning Aided Class-Incremental Lifelong Learning

A Broad Neural Network Structure for Class Incremental Learning.

Incremental Concept Learning via Online Generative Memory Recall