Abstract:Object detection (OD) is a basic computer vision task. To date, there have been many OD algorithms or models for solving different problems. The performance of the current models has gradually improved and their applications have expanded. However, the models have also become more complex, with larger numbers of parameters, making them unsuitable for industrial applications. The knowledge distillation (KD) technology proposed in 2015 was first applied to image classification in the field of computer vision, and quickly expanded to other visual tasks. The reason for this may be that the complex teacher models can transfer knowledge (learned from large-scale data or other multi-modal data) to lightweight student models, thereby achieving model compression and performance improvement. Although KD was only introduced into OD in 2017, recent years have seen a surge in publication of related works, especially in 2021 and 2022. Therefore, this paper presents a comprehensive survey of KD-based OD models over recent years, in the hope of providing researchers with an overview of recent progress in the field. Moreover, we have conducted in-depth analysis of the existing relevant works to ascertain their advantages and related issues, and further explored future research directions, in an attempt to provide researchers with inspiration and incentive to design models for related tasks. In brief, we summarize the basic principle of designing KD-based OD models, describe related KD-based OD tasks (performance improvements for lightweight models, catastrophic forgetting in incremental OD, small object detection (S-OD), weakly/semi-supervised OD, etc.), analyze the novel distillation techniques (different types of distillation loss, the feature interaction between teacher and student models, KD of multi-modal prior information, joint distillation using multiple teacher models, self-feature distillation, etc.), and present an overview of the extended applications on several specific datasets (remote sensing images, 3D point cloud datasets, etc.). After comparing and analyzing the performance of different models on several common datasets, we discuss promising directions for solving some specific OD problems.

Domain-invariant Progressive Knowledge Distillation for UAV-based Object Detection

Research on Knowledge Distillation Algorithm of Object Detection

Centerness-based Instance-aware Knowledge Distillation with Task-wise Mutual Lifting for Object Detection on Drone Imagery

Adaptive Knowledge Distillation for Lightweight Remote Sensing Object Detectors Optimizing

Cross-Modal Object Detection via UAV

When Object Detection Meets Knowledge Distillation: A Survey

Incremental Detection of Remote Sensing Objects with Feature Pyramid and Knowledge Distillation

RDR-KD: A Knowledge Distillation Detection Framework for Drone Scenes

Shared Knowledge Distillation Network for Object Detection

Knowledge Distillation for Oriented Object Detection on Aerial Images

A Novel Tensor Decomposition-Based Efficient Detector for Low-Altitude Aerial Objects With Knowledge Distillation Scheme

Directional Alignment Instance Knowledge Distillation for Arbitrary-Oriented Object Detection

Two-Way Assistant: A Knowledge Distillation Object Detection Method for Remote Sensing Images

Mosaicking to Distill: Knowledge Distillation from Out-of-Domain Data

Structured Knowledge Distillation for Accurate and Efficient Object Detection

Feature-Based Knowledge Distillation for Infrared Small Target Detection

Efficient Object Detection in Optical Remote Sensing Imagery via Attention-Based Feature Distillation

Lightweight UAV Object-Detection Method Based on Efficient Multidimensional Global Feature Adaptive Fusion and Knowledge Distillation

Foreground separation knowledge distillation for object detection

Teaching with Uncertainty: Unleashing the Potential of Knowledge Distillation in Object Detection