Abstract:Unmanned aerial vehicles (UAVs) equipped with remote-sensing object-detection devices are increasingly employed across diverse domains. However, the detection of small, densely-packed objects against complex backgrounds and at various scales presents a formidable challenge to conventional detection algorithms, exacerbated by the computational constraints of UAV-embedded systems that necessitate a delicate balance between detection speed and accuracy. To address these issues, this paper proposes the Efficient Multidimensional Global Feature Adaptive Fusion Network (MGFAFNET), an innovative detection method for UAV platforms. The novelties of our approach are threefold: Firstly, we introduce the Dual-Branch Multidimensional Aggregation Backbone Network (DBMA), an efficient architectural innovation that captures multidimensional global spatial interactions, significantly enhancing feature distinguishability for complex and occluded targets. Simultaneously, it reduces the computational burden typically associated with processing high-resolution imagery. Secondly, we construct the Dynamic Spatial Perception Feature Fusion Network (DSPF), which is tailored specifically to accommodate the notable scale variances encountered during UAV operation. By implementing a multi-layer dynamic spatial fusion coupled with feature-refinement modules, the network adeptly minimizes informational redundancy, leading to more efficient feature representation. Finally, our novel Localized Compensation Dual-Mask Distillation (LCDD) strategy is devised to adeptly translate the rich local and global features from the higher-capacity teacher network to the more resource-constrained student network, capturing both low-level spatial details and high-level semantic cues with unprecedented efficacy. The practicability and superior performance of our MGFAFNET are corroborated by a dedicated UAV detection platform, showcasing remarkable improvements over state-of-the-art object-detection methods, as demonstrated by rigorous evaluations conducted using the VisDrone2021 benchmark and a meticulously assembled proprietary dataset.

Real-Time Multi-Modal Active Vision for Object Detection on UAVs Equipped With Limited Field of View LiDAR and Camera

Fast Detection and Recognition Method of UAV in Sky Background

A Small UAV Detection Method Based on Optical Flow and Visual Feature Fusion

Detection and Recognition Method of Fast Low-Altitude Unmanned Aerial Vehicle Based on Dual Channel

Monocular-GPS Fusion 3D Object Detection for UAVs

Detection of Military Targets on Ground and Sea by UAVs with Low-Altitude Oblique Perspective

RTM-UAVDet: A Real-Time Multimodal UAV Detector

Lightweight Unmanned Aerial Vehicle Video Object Detection Based on Spatial-Temporal Correlation

UAV Tracking with Lidar as a Camera Sensors in GNSS-Denied Environments

A Deep Learning Method Based on the Multi-stage Fusion of Radar and Camera in UAV Obstacle Avoidance

Real-Time Object Detection Network in UAV-Vision Based on CNN and Transformer.

Real-Time Multi-Modal Semantic Fusion on Unmanned Aerial Vehicles

Real-time Active Detection of Targets and Path Planning Using UAVs

Lightweight UAV Object-Detection Method Based on Efficient Multidimensional Global Feature Adaptive Fusion and Knowledge Distillation

YOLO-UAV: Object Detection Method of Unmanned Aerial Vehicle Imagery Based on Efficient Multi-Scale Feature Fusion

Vision-based system for a real-time detection and following of UAV

Real time object detection using LiDAR and camera fusion for autonomous driving

Object Detection Deployed on UAVs for Oblique Images by Fusing IMU Information

Vision-Based Sense and Avoid with Monocular Vision and Real-Time Object Detection for UAVs

UAV Active Perception and Motion Control for Improving Navigation Using Low-Cost Sensors

Real-Time Detection for Small UAVs: Combining YOLO and Multi-frame Motion Analysis