Abstract:Deep networks have shown remarkable results in the task of object detection. However, their performance suffers critical drops when they are subsequently trained on novel classes without any sample from the base classes originally used to train the model. This phenomenon is known as catastrophic forgetting. Recently, several incremental learning methods are proposed to mitigate catastrophic forgetting for object detection. Despite the effectiveness, these methods require co-occurrence of the unlabeled base classes in the training data of the novel classes. This requirement is impractical in many real-world settings since the base classes do not necessarily co-occur with the novel classes. In view of this limitation, we consider a more practical setting of complete absence of co-occurrence of the base and novel classes for the object detection task. We propose the use of unlabeled in-the-wild data to bridge the non co-occurrence caused by the missing base classes during the training of additional novel classes. To this end, we introduce a blind sampling strategy based on the responses of the base-class model and pre-trained novel-class model to select a smaller relevant dataset from the large in-the-wild dataset for incremental learning. We then design a dual-teacher distillation framework to transfer the knowledge distilled from the base- and novel-class teacher models to the student model using the sampled in-the-wild data. Additionally, the novel class data is in the training to facilitate the learning of discriminative representations between base and novel classes. Furthermore, on the consideration that the training samples are all false positives when there is no class overlap in the in-the-wild data, we propose a single-teacher distillation framework to relieve the mutual suppression of the dual-teacher distillation framework and balance a trade-off between the performances of base and novel classes. Experimental results on the PASCAL VOC and MS-COCO datasets show that our proposed method significantly outperforms other state-of-the-art class-incremental object detection methods when there is no co-occurrence between the base and novel classes during training.

Incremental Learning of Single-stage Detectors with Mining Memory Neurons

Incremental Learning of Object Detectors without Catastrophic Forgetting

Incremental Detection of Remote Sensing Objects with Feature Pyramid and Knowledge Distillation

Learning-Without-Forgetting Via Memory Index in Incremental Object Detection.

Towards Non Co-occurrence Incremental Object Detection with Unlabeled In-the-Wild Data

Meta-Learning-Based Incremental Few-Shot Object Detection

Bridging Non Co-occurrence with Unlabeled In-the-wild Data for Incremental Object Detection

Incremental Object Detection Method Based on Border Distance Measurement

Incremental Learning of Object Detection with Output Merging of Compact Expert Detectors

Pseudo Object Replay and Mining for Incremental Object Detection

A New Knowledge Distillation for Incremental Object Detection

Multi-Task Incremental Learning for Object Detection

Learning Causal Features for Incremental Object Detection

RD-IOD: Two-Level Residual-Distillation-Based Triple-Network for Incremental Object Detection

Enhancing class-incremental object detection in remote sensing through instance-aware distillation

SID: Incremental learning for anchor-free object detection via Selective and Inter-related Distillation

Towards Class-incremental Object Detection with Nearest Mean of Exemplars

Revisiting Class-Incremental Object Detection: an Efficient Approach Via Intrinsic Characteristics Alignment and Task Decoupling

One-Shot Replay: Boosting Incremental Object Detection via Retrospecting One Object

Class-Incremental SAR Obeject Detection Via Adaptive Distributed Response Distillation

IncDet: in Defense of Elastic Weight Consolidation for Incremental Object Detection