Abstract:Object detection in remote sensing images identifies and extracts the acquired Earth surface information, providing data support and research basis for multiple fields. Remote sensing image object detection based on knowledge distillation (KD) can transfer the knowledge of a large teacher model to a smaller student model, achieving the effect of low parameter volume and high accuracy. Mainstream methods directly imitate teacher features to improve student performance, ignoring the generation of high-ranking features through teacher features instructing student feature maps in this knowledge transfer process. In this article, an adaptive composite feature generation (ACFG) strategy is proposed to achieve end-to-end trainable KD for object detection in remote sensing images, in which the robustness of feature points under composite masks is improved through adaptive feature mapping. In particular, a composite mask generator (CMG) module is proposed to select student instance-related features and point background features. Furthermore, a global and local projection layer (GLPL) module is proposed to connect the local information and global information of the feature map under the mask generator to adaptively realize the global recovery mapping of the feature map with partial feature points. Finally, balanced decoupling loss (BDL) is improved to handle foreground and background loss separately, so that the two decoupled features can better enable the student model to learn instance-related information. Note that the proposed ACFG is capable of conducting KD for both single-stage and two-stage object detectors. Experimental results using both anchor-based and anchor-free detectors on the DIOR dataset and DOTA dataset demonstrate that the proposed ACFG clearly achieved better performance than several state-of-the-art (SOTA) algorithms for KD.

Knowledge Transfer for Object Detection with Evolution Architecture Search

Research on Knowledge Distillation Algorithm of Object Detection

Joint Feature-Level And Pixel-Level Domain Adaption For Object Detection In The Wild

Multi-Objective Evolutionary for Object Detection Mobile Architectures Search

Domain adaptive object detection with model-agnostic knowledge transferring

Multilevel Knowledge Transfer for Cross-Domain Object Detection

Zero-Annotation Object Detection with Web Knowledge Transfer

Multi-source unsupervised domain adaptation for object detection

Adaptive Composite Feature Generation for Object Detection in Remote Sensing Images

Efficient Neural Architecture Transformation Searchin Channel-Level for Object Detection

Incremental learning based multi-domain adaptation for object detection

DA-NAS: Learning Transferable Architecture for Unsupervised Domain Adaptation

Multidomain Object Detection Framework Using Feature Domain Knowledge Distillation.

Network Architecture Search for Domain Adaptation

Neural Architecture Adaptation for Object Detection by Searching Channel Dimensions and Mapping Pre-trained Parameters

Multi-objective Neural Architecture Adaptation in Transfer Learning

A Fast Evolutionary Knowledge Transfer Search for Multiscale Deep Neural Architecture

Joint Learning of Neural Transfer and Architecture Adaptation for Image Recognition

Object Detection in Remote Sensing Images Based on Deep Transfer Learning

MOD-NAS: Migration-Based Object Detection Neural Architecture Search

Multi-Level Domain Adaptive Learning For Cross-Domain Detection