Abstract:As a basic component in multimedia applications, object detectors are generally trained on a fixed set of classes that are pre-defined. However, new object classes often emerge after the models are trained in practice. Modern object detectors based on Convolutional Neural Networks (CNN) suffer from catastrophic forgetting when fine-tuning on new classes without the original training data. Therefore, it is critical to improve the incremental learning capability on object detection. In this article, we propose a novel Residual-Distillation-based Incremental learning method on Object Detection (RD-IOD). Our approach rests on the creation of a triple-network based on Faster R-CNN. To enable continuous learning from new classes, we use the original model as well as a residual model to guide the learning of the incremental model on new classes while maintaining the previous learned knowledge. To better maintain the discrimination between the features of old and new classes, the residual model is jointly trained with the incremental model on new classes in the incremental learning procedure. In addition, a two-level distillation scheme is designed to guide the training process, which consists of (1) a general distillation for imitating the original model in feature space along with a residual distillation on the features in both image level and instance level, and (2) a joint classification distillation on the output layers. To well preserve the learned knowledge, we design a 2-threshold training strategy to guide the learning of a Region Proposal Network and a detection head. Extensive experiments conducted on VOC2007 and COCO demonstrate that the proposed method can effectively learn to incrementally detect objects of new classes, and the problem of catastrophic forgetting is mitigated. Our code is available at https://github.com/yangdb/RD-IOD.

Domain Incremental Object Detection Based on Feature Space Topology Preserving Strategy

Incremental Learning of Object Detectors without Catastrophic Forgetting

Incremental learning based multi-domain adaptation for object detection

Incremental Open-set Domain Adaptation

Non-exemplar Domain Incremental Object Detection via Learning Domain Bias

Incremental Detection of Remote Sensing Objects with Feature Pyramid and Knowledge Distillation

Multi-Task Incremental Learning for Object Detection

Learning Causal Features for Incremental Object Detection

Incremental Learning of Single-stage Detectors with Mining Memory Neurons

RD-IOD: Two-Level Residual-Distillation-Based Triple-Network for Incremental Object Detection

Learning-Without-Forgetting Via Memory Index in Incremental Object Detection.

Enhancing class-incremental object detection in remote sensing through instance-aware distillation

DIODE: Dilatable Incremental Object Detection

SID: Incremental learning for anchor-free object detection via Selective and Inter-related Distillation

Purified Distillation: Bridging Domain Shift and Category Gap in Incremental Object Detection

Revisiting Class-Incremental Object Detection: an Efficient Approach Via Intrinsic Characteristics Alignment and Task Decoupling

Topology-Preserving Class-Incremental Learning

Continual Universal Object Detection

Incremental Object Detection with Image-level Labels

Towards Generalized and Incremental Few-Shot Object Detection

Incremental Scene Classification Using Dual Knowledge Distillation and Classifier Discrepancy on Natural and Remote Sensing Images