Abstract:As a basic component in multimedia applications, object detectors are generally trained on a fixed set of classes that are pre-defined. However, new object classes often emerge after the models are trained in practice. Modern object detectors based on Convolutional Neural Networks (CNN) suffer from catastrophic forgetting when fine-tuning on new classes without the original training data. Therefore, it is critical to improve the incremental learning capability on object detection. In this article, we propose a novel Residual-Distillation-based Incremental learning method on Object Detection (RD-IOD). Our approach rests on the creation of a triple-network based on Faster R-CNN. To enable continuous learning from new classes, we use the original model as well as a residual model to guide the learning of the incremental model on new classes while maintaining the previous learned knowledge. To better maintain the discrimination between the features of old and new classes, the residual model is jointly trained with the incremental model on new classes in the incremental learning procedure. In addition, a two-level distillation scheme is designed to guide the training process, which consists of (1) a general distillation for imitating the original model in feature space along with a residual distillation on the features in both image level and instance level, and (2) a joint classification distillation on the output layers. To well preserve the learned knowledge, we design a 2-threshold training strategy to guide the learning of a Region Proposal Network and a detection head. Extensive experiments conducted on VOC2007 and COCO demonstrate that the proposed method can effectively learn to incrementally detect objects of new classes, and the problem of catastrophic forgetting is mitigated. Our code is available at https://github.com/yangdb/RD-IOD.

Augmented Box Replay: Overcoming Foreground Shift for Incremental Object Detection

IOR: Inversed Objects Replay for Incremental Object Detection

One-Shot Replay: Boosting Incremental Object Detection via Retrospecting One Object

Continual Learning: Less Forgetting, More OOD Generalization via Adaptive Contrastive Replay

Bridge Past and Future: Overcoming Information Asymmetry in Incremental Object Detection

Pseudo Object Replay and Mining for Incremental Object Detection

Replay Consolidation with Label Propagation for Continual Object Detection

Dynamic Replay Training for Class-Incremental Learning

CORE: Mitigating Catastrophic Forgetting in Continual Learning through Cognitive Replay

ONER: Online Experience Replay for Incremental Anomaly Detection

Overcoming Catastrophic Forgetting in Incremental Object Detection via Elastic Response Distillation

SDDGR: Stable Diffusion-based Deep Generative Replay for Class Incremental Object Detection

Enhancing Consistency and Mitigating Bias: A Data Replay Approach for Incremental Learning

May the Forgetting Be with You: Alternate Replay for Learning with Noisy Labels

Replay-enhanced Continual Reinforcement Learning

M EMORY R EPLAY WITH D ATA C OMPRESSION FOR C ONTINUAL L EARNING

RT-Net: replay-and-transfer network for class incremental object detection

Incremental Object Detection with CLIP

RD-IOD: Two-Level Residual-Distillation-Based Triple-Network for Incremental Object Detection

Continual Recognition with Adaptive Memory Update.

Incremental Learning of Object Detectors without Catastrophic Forgetting