Abstract:Object detection in unmanned aerial vehicle (UAV) imagery is a meaningful foundation in various research domains. However, UAV imagery poses unique challenges, including large image sizes, small sizes detection objects, dense distribution, overlapping instances, and insufficient lighting impacting the effectiveness of object detection. In this article, we propose Drone-YOLO, a series of multi-scale UAV image object detection algorithms based on the YOLOv8 model, designed to overcome the specific challenges associated with UAV image object detection. To address the issues of large scene sizes and small detection objects, we introduce improvements to the neck component of the YOLOv8 model. Specifically, we employ a three-layer PAFPN structure and incorporate a detection head tailored for small-sized objects using large-scale feature maps, significantly enhancing the algorithm’s capability to detect small-sized targets. Furthermore, we integrate the sandwich-fusion module into each layer of the neck’s up–down branch. This fusion mechanism combines network features with low-level features, providing rich spatial information about the objects at different layer detection heads. We achieve this fusion using depthwise separable evolution, which balances parameter costs and a large receptive field. In the network backbone, we employ RepVGG modules as downsampling layers, enhancing the network’s ability to learn multi-scale features and outperforming traditional convolutional layers. The proposed Drone-YOLO methods have been evaluated in ablation experiments and compared with other state-of-the-art approaches on the VisDrone2019 dataset. The results demonstrate that our Drone-YOLO (large) outperforms other baseline methods in the accuracy of object detection. Compared to YOLOv8, our method achieves a significant improvement in mAP0.5 metrics, with a 13.4% increase on the VisDrone2019-test and a 17.40% increase on the VisDrone2019-val. Additionally, the parameter-efficient Drone-YOLO (tiny) with only 5.25 M parameters performs equivalently or better than the baseline method with 9.66M parameters on the dataset. These experiments validate the effectiveness of the Drone-YOLO methods in the task of object detection in drone imagery.

VDTNet: A High-Performance Visual Network for Detecting and Tracking of Intruding Drones

A Training-time Friendly Network for Real-time Drone Detection.

DroneNet: Rescue Drone-View Object Detection

Real-Time Drone Detection Using Deep Learning Approach.

Real-Time Detection of Drones Using Channel and Layer Pruning, Based on the YOLOv3-SPP3 Deep Learning Algorithm

Drone-DETR: Efficient Small Object Detection for Remote Sensing Image Using Enhanced RT-DETR Model

Real-Time Small Drones Detection Based on Pruned YOLOv4

Drone-YOLO: An Efficient Neural Network Method for Target Detection in Drone Images

A Modified YOLOv8 Detection Network for UAV Aerial Image Recognition

DeepVision: Enhanced Drone Detection and Recognition in Visible Imagery through Deep Learning Networks

LDHD‐Net: A Lightweight Network With Double Branch Head for Feature Enhancement of UAV Targets in Complex Scenes

Efficient YOLOv7-Drone: An Enhanced Object Detection Approach for Drone Aerial Imagery

YOLO-Drone: An Optimized YOLOv8 Network for Tiny UAV Object Detection

High-precision real-time UAV target recognition based on improved YOLOv4

Drone-TOOD: A Lightweight Task-Aligned Object Detection Algorithm for Vehicle Detection in UAV Images

AIMED-Net: An Enhancing Infrared Small Target Detection Net in UAVs with Multi-Layer Feature Enhancement for Edge Computing

Object Detection of Visdrone based on Attention Mechanism and FasterNet

Real-time recognition application for UAV based on YOLOv5