Abstract:Unmanned aerial vehicles (UAVs) are now widely used in many fields. Due to the randomness of UAV flight height and shooting angle, UAV images usually have the following characteristics: many small objects, large changes in object scale, and complex background. Therefore, object detection in UAV aerial images is a very challenging task. To address the challenges posed by these characteristics, this paper proposes a novel UAV image object detection method based on global feature aggregation and context feature extraction named the multi-scale feature information extraction and fusion network (MFEFNet). Specifically, first of all, to extract the feature information of objects more effectively from complex backgrounds, we propose an efficient spatial information extraction (SIEM) module, which combines residual connection to build long-distance feature dependencies and effectively extracts the most useful feature information by building contextual feature relations around objects. Secondly, to improve the feature fusion efficiency and reduce the burden brought by redundant feature fusion networks, we propose a global aggregation progressive feature fusion network (GAFN). This network adopts a three-level adaptive feature fusion method, which can adaptively fuse multi-scale features according to the importance of different feature layers and reduce unnecessary intermediate redundant features by utilizing the adaptive feature fusion module (AFFM). Furthermore, we use the MPDIoU loss function as the bounding-box regression loss function, which not only enhances model robustness to noise but also simplifies the calculation process and improves the final detection efficiency. Finally, the proposed MFEFNet was tested on VisDrone and UAVDT datasets, and the mAP0.5 value increased by 2.7% and 2.2%, respectively.

Extended Feature Pyramid Network with Adaptive Scale Training Strategy and Anchors for Object Detection in Aerial Images

Scale Enhancement Network for Object Detection in Aerial Images

Extended Feature Pyramid Network for Small Object Detection

Scale Enhancement Pyramid Network for Small Object Detection from UAV Images

Dense Multiscale Feature Fusion Pyramid Networks for Object Detection in UAV-Captured Images

Enhanced semantic feature pyramid network for small object detection

A Scale-Aware Pyramid Network for Multi-Scale Object Detection in SAR Images

Scale Decoupled Pyramid for Object Detection in Aerial Images

AFPN: Asymptotic Feature Pyramid Network for Object Detection

Multi-Stage Feature Enhancement Pyramid Network for Detecting Objects in Optical Remote Sensing Images

SSN: Scale Selection Network for Multi-Scale Object Detection in Remote Sensing Images

AMFEF-DETR: An End-to-End Adaptive Multi-Scale Feature Extraction and Fusion Object Detection Network Based on UAV Aerial Images

Scale Adaptive Feature Pyramid Networks for 2D Object Detection

Multi-scale Fusion Based Multi-stage Small Object Detection in Aerial Images ∗

ARFP: A novel adaptive recursive feature pyramid for object detection in aerial images

MM-FPN: Multi-path and Multi-scale Feature Pyramid Network for Object Detection

A Two-Way Dense Feature Pyramid Networks for Object Detection of Remote Sensing Images

Exploiting Cross-scale Consistency for Object Detection in Aerial Images

Object Detection in Aerial Remote Sensing Images with Multi-scale Feature Enhancement

Object Detection in Remote Sensing Images Based on Adaptive Multi-Scale Feature Fusion Method

MFEFNet: A Multi-Scale Feature Information Extraction and Fusion Network for Multi-Scale Object Detection in UAV Aerial Images