Abstract:Unmanned aerial vehicles (UAVs) have been widely used in various fields. As one of the key technologies in improving the autonomous sensing ability of UAV optical sensors, object detection has become a research focus in recent years. Since UAVs usually navigate at different vertical heights, the object scales and sensor field of view change violently, which brings a great difficulty to the optimization of the model. Moreover, when a UAV is flying at low level rapidly, it may cause the motion blur phenomenon on objects that are highly dense in position, leading to great challenge for distinction of these objects. To address the extremely tough problems discussed above, we propose an accurate and efficient object detection algorithm, namely, VAMYOLOX. Based on YOLOX, we first redesigned the classification and regression loss function of the model to better conduct classification and localization under complex motion blur and dense scenes. Then, we increase another prediction head to detect lots of tiny objects to ultimately improve the detection ability of the model for multiscale objects. Finally, we redesigned the neck of the network by introducing the triplet attention module (TAM) to find attention regions in scenes with dense objects and in images that cover a large area, accordingly enhancing the features extracted by the backbone network. Extensive experiments on the VisDrone dataset widely used in the research of UAV image object detection show that VAMYOLOX has achieved the state-of-the-art (SOTA) performance with good interpretability in UAV optical sensors captured scenes. On the VisDrone-DET-test-dev subset, the average precision (AP) of VAMYOLOX is 25.31%, outperforming the previous SOTA model (CornerNet) by 1.88%. On the VisDrone-DET-val subset, the AP of our method is 29.4%, achieving a highly competitive result with previous SOTA method (AMRNet). Not only that, VAMYOLOX achieves a maximum improvement of 2.72% compared to the AP of the baseline model (YOLOX). In addition, compared with other methods, our method has a significant advantage in speed and can meet the needs of different scenarios. The PyTorch code and trained models are available at https://github.com/yangyahu-1994/VAMYOLOX.

UAV-YOLOX: An Accurate Object Detection Method for UAV Images.

VAMYOLOX: an Accurate and Efficient Object Detection Algorithm Based on Visual Attention Mechanism for UAV Optical Sensors

YOLO-Drone: An Optimized YOLOv8 Network for Tiny UAV Object Detection

Target Detection Method of UAV Aerial Imagery Based on Improved YOLOv5

A Modified YOLOv5 for Object Detection in UAV-captured Scenarios

UAV-YOLOv8: A Small-Object-Detection Model Based on Improved YOLOv8 for UAV Aerial Photography Scenarios

Small Object Detection in UAV Images Based on YOLOv8n

YOLOD: A Target Detection Method for UAV Aerial Imagery

YOLOv7-UAV: An Unmanned Aerial Vehicle Image Object Detection Algorithm Based on Improved YOLOv7

Research on Object Detection and Recognition Method for UAV Aerial Images Based on Improved YOLOv5

A Lightweight and Accurate UAV Detection Method Based on YOLOv4

UAV-YOLO: Small Object Detection on Unmanned Aerial Vehicle Perspective

Mob-YOLO: A Lightweight UAV Object Detection Method

URS-YOLOv5s: Object Detection Algorithm for UAV Remote Sensing Images

A novel small object detection algorithm for UAVs based on YOLOv5

YOLOv4_Drone: UAV image target detection based on an improved YOLOv4 algorithm

An Improved YOLOv5 Method for Small Object Detection in UAV Capture Scenes

UAV Target Detection Algorithm Based on Improved YOLOv8

YOLOv7-P: a lighter and more effective UAV aerial photography object detection algorithm