Abstract:Deep networks have shown remarkable results in the task of object detection. However, their performance suffers critical drops when they are subsequently trained on novel classes without any sample from the base classes originally used to train the model. This phenomenon is known as catastrophic forgetting. Recently, several incremental learning methods are proposed to mitigate catastrophic forgetting for object detection. Despite the effectiveness, these methods require co-occurrence of the unlabeled base classes in the training data of the novel classes. This requirement is impractical in many real-world settings since the base classes do not necessarily co-occur with the novel classes. In view of this limitation, we consider a more practical setting of complete absence of co-occurrence of the base and novel classes for the object detection task. We propose the use of unlabeled in-the-wild data to bridge the non co-occurrence caused by the missing base classes during the training of additional novel classes. To this end, we introduce a blind sampling strategy based on the responses of the base-class model and pre-trained novel-class model to select a smaller relevant dataset from the large in-the-wild dataset for incremental learning. We then design a dual-teacher distillation framework to transfer the knowledge distilled from the base- and novel-class teacher models to the student model using the sampled in-the-wild data. Additionally, the novel class data is in the training to facilitate the learning of discriminative representations between base and novel classes. Furthermore, on the consideration that the training samples are all false positives when there is no class overlap in the in-the-wild data, we propose a single-teacher distillation framework to relieve the mutual suppression of the dual-teacher distillation framework and balance a trade-off between the performances of base and novel classes. Experimental results on the PASCAL VOC and MS-COCO datasets show that our proposed method significantly outperforms other state-of-the-art class-incremental object detection methods when there is no co-occurrence between the base and novel classes during training.

Incremental Learning of Object Detectors without Catastrophic Forgetting

Incremental Learning of Single-stage Detectors with Mining Memory Neurons

Bridging Non Co-occurrence with Unlabeled In-the-wild Data for Incremental Object Detection

Towards Non Co-occurrence Incremental Object Detection with Unlabeled In-the-Wild Data

SID: Incremental learning for anchor-free object detection via Selective and Inter-related Distillation

Contrastive R-CNN for Incremental Learning in Object Detection.

Learning Causal Features for Incremental Object Detection

Multi-Task Incremental Learning for Object Detection

Towards Class-incremental Object Detection with Nearest Mean of Exemplars

Overcoming Catastrophic Forgetting in Incremental Object Detection via Elastic Response Distillation

RD-IOD: Two-Level Residual-Distillation-Based Triple-Network for Incremental Object Detection

IncDet: in Defense of Elastic Weight Consolidation for Incremental Object Detection

Incremental Learning Using Conditional Adversarial Networks

Incremental Detection of Remote Sensing Objects with Feature Pyramid and Knowledge Distillation

Revisiting Class-Incremental Object Detection: an Efficient Approach Via Intrinsic Characteristics Alignment and Task Decoupling

Decoupled Mutual Distillation for Incremental Object Detection

Incremental Object Detection Method Based on Border Distance Measurement

DIODE: Dilatable Incremental Object Detection

Incremental Object Detection with CLIP

Enhancing class-incremental object detection in remote sensing through instance-aware distillation

Static-Dynamic Co-Teaching for Class-Incremental 3D Object Detection