Abstract:As a basic component in multimedia applications, object detectors are generally trained on a fixed set of classes that are pre-defined. However, new object classes often emerge after the models are trained in practice. Modern object detectors based on Convolutional Neural Networks (CNN) suffer from catastrophic forgetting when fine-tuning on new classes without the original training data. Therefore, it is critical to improve the incremental learning capability on object detection. In this article, we propose a novel Residual-Distillation-based Incremental learning method on Object Detection (RD-IOD). Our approach rests on the creation of a triple-network based on Faster R-CNN. To enable continuous learning from new classes, we use the original model as well as a residual model to guide the learning of the incremental model on new classes while maintaining the previous learned knowledge. To better maintain the discrimination between the features of old and new classes, the residual model is jointly trained with the incremental model on new classes in the incremental learning procedure. In addition, a two-level distillation scheme is designed to guide the training process, which consists of (1) a general distillation for imitating the original model in feature space along with a residual distillation on the features in both image level and instance level, and (2) a joint classification distillation on the output layers. To well preserve the learned knowledge, we design a 2-threshold training strategy to guide the learning of a Region Proposal Network and a detection head. Extensive experiments conducted on VOC2007 and COCO demonstrate that the proposed method can effectively learn to incrementally detect objects of new classes, and the problem of catastrophic forgetting is mitigated. Our code is available at https://github.com/yangdb/RD-IOD.

RT-Net: replay-and-transfer network for class incremental object detection

RD-IOD: Two-Level Residual-Distillation-Based Triple-Network for Incremental Object Detection

Selective Transfer with Reinforced Transfer Network for Partial Domain Adaptation.

One-Shot Replay: Boosting Incremental Object Detection via Retrospecting One Object

MultIOD: Rehearsal-free Multihead Incremental Object Detector

IOR: Inversed Objects Replay for Incremental Object Detection

SDDGR: Stable Diffusion-based Deep Generative Replay for Class Incremental Object Detection

Pseudo Object Replay and Mining for Incremental Object Detection

Class incremental learning of remote sensing images based on class similarity distillation

Dynamic Replay Training for Class-Incremental Learning

Enhancing class-incremental object detection in remote sensing through instance-aware distillation

Contrastive R-CNN for Incremental Learning in Object Detection.

Revisiting Class-Incremental Object Detection: an Efficient Approach Via Intrinsic Characteristics Alignment and Task Decoupling

Incremental Learning of Object Detectors without Catastrophic Forgetting

Faster ILOD: Incremental learning for object detectors based on faster RCNN

Augmented Box Replay: Overcoming Foreground Shift for Incremental Object Detection

CIOD: an intelligent class-incremental object detection system with nearest mean of exemplars

Generative Feature Replay For Class-Incremental Learning

nVFNet-RDC: Replay and Non-Local Distillation Collaboration for Continual Object Detection

A New Knowledge Distillation for Incremental Object Detection

A New Multinetwork Mean Distillation Loss Function for Open-World Domain Incremental Object Detection