Abstract:Object detection is a pivotal task for many unmanned aerial vehicle (UAV) applications. Compared to general scenes, the objects in aerial images are typically much smaller. For this reason, most general object detectors suffer from two critical challenges while dealing with aerial images: 1) The widely exploited Feature Pyramid Network works by integrating high-level features to lower levels progressively. However, this manner does not transfer equivalent information from each level of backbone network to the generated features, and the shared detection head faces an unbalanced sources of information flow, damaging the detection accuracy. 2) Up-sampling is commonly used to expand feature resolution for feature fusion or feature aggregation. However, existing up-sampling methods are ineffective to reconstruct high resolution feature maps. To address these two challenges, two works are proposed: 1) An up-scale feature aggregation framework that fully utilizes multi-scale complementary information, and 2) a novel up-sampling method that further improve detection accuracy. These two proposals are integrated into an end-to-end single-stage object detector namely HawkNet. Extensive experiments are conducted on VisDrone-DET2018, UAVDT and DIOR datasets. Compared to the RetinaNet baseline, our HawkNet achieves absolute gains of 6.0%, 1.2% and 5.9% in average precision (AP) on VisDrone-DET2018, UAVDT and DIOR datasets, respectively. For a 800 x 1333 input on the UAVDT dataset, HawkNet with ResNet50 backbone surpasses existing methods for single-scale inference and achieves the best performance (37.4 AP), while operating at 10.6 frames per second on a single Nvidia GTX 1080Ti GPU. (c) 2020 Elsevier B.V. All rights reserved.

Gaining Scale Invariance in UAV Bird's Eye View Object Detection by Adaptive Resizing

Efficient and Accurate Giraffe-Det for UAV Image Based Object Detection

Diminishing Domain Bias by Leveraging Domain Labels in Object Detection on UAVs

Object Detection Deployed on UAVs for Oblique Images by Fusing IMU Information

Scale Adaptive Image Cropping for UAV Object Detection

Scale Decoupled Pyramid for Object Detection in Aerial Images

Hierarchical Scale Awareness for Object Detection in Unmanned Aerial Vehicle Scenes

Pas: a scale-invariant approach to maritime search and rescue object detection using preprocessing and attention scaling

Comprehensive Analysis of the Object Detection Pipeline on UAVs

Learnable Cross-Scale Sparse Attention Guided Feature Fusion for UAV Object Detection

Domain Feature Decomposition for Efficient Object Detection in Aerial Images

Small-Object Detection for UAV-Based Images Using a Distance Metric Method

Boost UAV-based Ojbect Detection via Scale-Invariant Feature Disentanglement and Adversarial Learning

Scale-Aware Domain Adaptation for Robust UAV Tracking

Enhancing object detection in aerial images

Leveraging Synthetic Data in Object Detection on Unmanned Aerial Vehicles

Novel Up-Scale Feature Aggregation for Object Detection in Aerial Images

Small or Far Away? Exploiting Deep Super-Resolution and Altitude Data for Aerial Animal Surveillance

An Efficient UAV Image Object Detection Algorithm Based on Global Attention and Multi-Scale Feature Fusion

Tackling the Background Bias in Sparse Object Detection via Cropped Windows

Small Object Detection in Unmanned Aerial Vehicle Images Using Feature Fusion and Scaling-Based Single Shot Detector with Spatial Context Analysis