Abstract:With the rapid development of remote sensing technology and the growing demand for applications, the classical deep learning-based object detection model is bottlenecked in processing incremental data, especially in the increasing classes of detected objects. It requires models to sequentially learn new classes of objects based on the current model, while preserving old categories-related knowledge. Existing class-incremental detection methods achieve this goal mainly by constraining the optimization trajectory in the feature of output space. However, these works neglect the case where the previously learned background is a new category to learn, resulting in performance degradation in the new category because of the conflict between remaining the background-related knowledge or updating the background-related knowledge. This paper proposes a novel class-incremental detection method incorporated with the teacher-student architecture and the selective distillation (SDCID) strategy. Specifically, it is the asymmetry architecture, i.e., the teacher network temporarily stores historical knowledge of previously learned objects, and the student network integrates historical knowledge from the teacher network with the newly learned object-related knowledge, respectively. This asymmetry architecture reveals the significance of the distinct representation of history knowledge and new knowledge in incremental detection. Furthermore, SDCID selectively masks the shared subobject of new images to learn and previously learned background, while learning new categories of images and then transfers the classification results of the student model to the background class following the judgment model of the teacher model. This manner avoids interferences between the background category-related knowledge from a teacher model and the learning of other new classes of objects. In addition, we proposed a new incremental learning evaluation metric, C-SP, to comprehensively evaluate the incremental learning stability and plasticity performance. We verified the proposed method on two object detection datasets of remote sensing images, i.e., DIOR and DOTA. The experience results in accuracy and C-SP suggest that the proposed method surpasses existing class-incremental detection methods. We further analyzed the influence of the mask component in our method and the hyper-parameters sensitive to our method.

Distillation-Constrained Prototype Representation Network for Hyperspectral Image Incremental Classification

Incremental Classification of Remote Sensing Images with Feature Pyramid and Class Hierarchy

Incremental Scene Classification Using Dual Knowledge Distillation and Classifier Discrepancy on Natural and Remote Sensing Images

A Class-Incremental Detection Method of Remote Sensing Images Based on Selective Distillation

Hyper-feature aggregation and relaxed distillation for class incremental learning

Class-Incremental Learning for Remote Sensing Images Based on Knowledge Distillation

Class incremental learning of remote sensing images based on class similarity distillation

Class-Incremental Recognition of Objects in Remote Sensing Images with Dynamic Hybrid Exemplar Selection

Inherit With Distillation and Evolve With Contrast: Exploring Class Incremental Semantic Segmentation Without Exemplar Memory

Hyperspectral Image Classification Promotion Using Dynamic Convolution Based on Structural Re-Parameterization

Adversarial Domain Adaptation Network With Calibrated Prototype and Dynamic Instance Convolution for Hyperspectral Image Classification

Integrating Prototype Learning With Graph Convolution Network for Effective Active Hyperspectral Image Classification

Class incremental learning with self-supervised pre-training and prototype learning

Multi-Teacher Knowledge Distillation for Incremental Implicitly-Refined Classification

Multi-granularity knowledge distillation and prototype consistency regularization for class-incremental learning

Life-Long Learning with Continual Spectral-Spatial Feature Distillation for Hyperspectral Image Classification.

DCTN: Dual-Branch Convolutional Transformer Network With Efficient Interactive Self-Attention for Hyperspectral Image Classification

Fortifying Centers and Edges: Multidomain Feature Learning Meets Hyperspectral Image Classification

Domain Invariant and Compact Prototype Contrast Adaptation for Hyperspectral Image Classification

Mutually Promoted Hierarchical Learning for Incremental Implicitly-Refined Classification

Multivariate Prototype Representation for Domain-Generalized Incremental Learning