Abstract:Unmanned aerial vehicles (UAVs) are now widely used in many fields. Due to the randomness of UAV flight height and shooting angle, UAV images usually have the following characteristics: many small objects, large changes in object scale, and complex background. Therefore, object detection in UAV aerial images is a very challenging task. To address the challenges posed by these characteristics, this paper proposes a novel UAV image object detection method based on global feature aggregation and context feature extraction named the multi-scale feature information extraction and fusion network (MFEFNet). Specifically, first of all, to extract the feature information of objects more effectively from complex backgrounds, we propose an efficient spatial information extraction (SIEM) module, which combines residual connection to build long-distance feature dependencies and effectively extracts the most useful feature information by building contextual feature relations around objects. Secondly, to improve the feature fusion efficiency and reduce the burden brought by redundant feature fusion networks, we propose a global aggregation progressive feature fusion network (GAFN). This network adopts a three-level adaptive feature fusion method, which can adaptively fuse multi-scale features according to the importance of different feature layers and reduce unnecessary intermediate redundant features by utilizing the adaptive feature fusion module (AFFM). Furthermore, we use the MPDIoU loss function as the bounding-box regression loss function, which not only enhances model robustness to noise but also simplifies the calculation process and improves the final detection efficiency. Finally, the proposed MFEFNet was tested on VisDrone and UAVDT datasets, and the mAP0.5 value increased by 2.7% and 2.2%, respectively.

SiamMFF: UAV Object Tracking Algorithm Based on Multi-Scale Feature Fusion

Flow-Guided Single Object Tracking Framework in UAV Aerial Video

A Small UAV Detection Method Based on Optical Flow and Visual Feature Fusion

Low in Resolution, High in Precision: UAV Detection with Super-Resolution and Motion Information Extraction

Multilevel Spatial-Temporal Feature Aggregation for Video Object Detection

Multi-scale object detection in UAV images based on adaptive feature fusion

Scale-Aware Domain Adaptation for Robust UAV Tracking

Deformable Convolution-Guided Multiscale Feature Learning and Fusion for UAV Object Detection

SMFF-YOLO: A Scale-Adaptive YOLO Algorithm with Multi-Level Feature Fusion for Object Detection in UAV Scenes

Modality Meets Long-Term Tracker: A Siamese Dual Fusion Framework for Tracking UAV

Object Tracking in Unmanned Aerial Vehicle Videos via Multifeature Discrimination and Instance-Aware Attention Network

Multi-Object Tracking Meets Moving UAV

Adaptive Feature Fusion and Improved Attention Mechanism-Based Small Object Detection for UAV Target Tracking

MFEFNet: A Multi-Scale Feature Information Extraction and Fusion Network for Multi-Scale Object Detection in UAV Aerial Images

Anti-Occlusion Visual Tracking Algorithm for UAVs with Multi-Feature Adaptive Fusion

Object Tracking in UAV Videos by Multifeature Correlation Filters With Saliency Proposals

Interactive Multi-scale Fusion of 2D and 3D Features for Multi-object Tracking

Multi-object tracking via deep feature fusion and association analysis

AMFEF-DETR: An End-to-End Adaptive Multi-Scale Feature Extraction and Fusion Object Detection Network Based on UAV Aerial Images

Adaptive Multi-Scale Tracking Target Algorithm Through Drone.

Correlation Filter-Based Visual Tracking for UAV with Online Multi-Feature Learning