Abstract:Deep networks have shown remarkable results in the task of object detection. However, their performance suffers critical drops when they are subsequently trained on novel classes without any sample from the base classes originally used to train the model. This phenomenon is known as catastrophic forgetting. Recently, several incremental learning methods are proposed to mitigate catastrophic forgetting for object detection. Despite the effectiveness, these methods require co-occurrence of the unlabeled base classes in the training data of the novel classes. This requirement is impractical in many real-world settings since the base classes do not necessarily co-occur with the novel classes. In view of this limitation, we consider a more practical setting of complete absence of co-occurrence of the base and novel classes for the object detection task. We propose the use of unlabeled in-the-wild data to bridge the non co-occurrence caused by the missing base classes during the training of additional novel classes. To this end, we introduce a blind sampling strategy based on the responses of the base-class model and pre-trained novel-class model to select a smaller relevant dataset from the large in-the-wild dataset for incremental learning. We then design a dual-teacher distillation framework to transfer the knowledge distilled from the base- and novel-class teacher models to the student model using the sampled in-the-wild data. Additionally, the novel class data is in the training to facilitate the learning of discriminative representations between base and novel classes. Furthermore, on the consideration that the training samples are all false positives when there is no class overlap in the in-the-wild data, we propose a single-teacher distillation framework to relieve the mutual suppression of the dual-teacher distillation framework and balance a trade-off between the performances of base and novel classes. Experimental results on the PASCAL VOC and MS-COCO datasets show that our proposed method significantly outperforms other state-of-the-art class-incremental object detection methods when there is no co-occurrence between the base and novel classes during training.

Overcoming Catastrophic Forgetting with Unlabeled Data in the Wild

Towards Non Co-occurrence Incremental Object Detection with Unlabeled In-the-Wild Data

Reducing Catastrophic Forgetting in Online Class Incremental Learning Using Self-Distillation

An Efficient Strategy for Catastrophic Forgetting Reduction in Incremental Learning

Overcoming Catastrophic Forgetting for Multi-Label Class-Incremental Learning

Learn to Grow: A Continual Structure Learning Framework for Overcoming Catastrophic Forgetting

Model Behavior Preserving for Class-Incremental Learning

Prior-Free Continual Learning with Unlabeled Data in the Wild

Bridging Non Co-occurrence with Unlabeled In-the-wild Data for Incremental Object Detection

Distilling Causal Effect of Data in Class-Incremental Learning

Maintaining Discrimination and Fairness in Class Incremental Learning

A Strategy for an Uncompromising Incremental Learner

Fine-Grained Knowledge Selection and Restoration for Non-Exemplar Class Incremental Learning

Memory Efficient Data-Free Distillation for Continual Learning.

Large Scale Incremental Learning

Curiosity-Driven Class-Incremental Learning Via Adaptive Sample Selection

Uncertainty-Guided Semi-Supervised Few-Shot Class-Incremental Learning With Knowledge Distillation

Overcoming catastrophic forgetting in neural networks

Class Incremental Learning with Deep Contrastive Learning and Attention Distillation

Incremental Learning of Object Detectors without Catastrophic Forgetting