Abstract:With the rise of deep learning networks, object detection technologies for unmanned aerial vehicle (UAV) have demonstrated outstanding performance in many application scenarios. However, current small object detection approaches overwhelmingly disregard sparse feature interactions and global context modeling, resulting in incomplete utilization and even loss of semantic information of small objects. Therefore, this study provides an advanced Assemble-and-Fusion mechanism used in DEtection TRansformer (AF-DETR), in which the aggregated global semantics are allocated across layers to augment fine-grained feature learning for small instances. Meanwhile, an adaptive context broadcasting module is designed to effectively integrate contextual information in the decoder, thus ensuring accurate detection of small objects. First, the last four stage features selected from the backbone are sent into the intra-scale feature interaction module, which performs self-attention operation on feature map of the last scale. Second, a fixed fusion module aligns and aggregates multi-scale representations prior to dissemination across layers. Features of adjoining levels then undergo transformation and consolidation within convolutional module. Finally, an enhanced adaptive context broadcasting module is introduced within the decoding MLP to incorporate aggregated semantics into individual tokens for broadcasting contextual information. Our AF-DETR achieves 49.5 mAP50 and 29.5 mAP50-95 on VisDrone2021 dataset, and impressive mAP50 results of 67.7% and 70.7% are achieved under RGB and Infrared modalities on the DroneVehicle dataset respectively. Extensive evaluations manifest consistent performance gains attained by our approach over state-of-the-art methods under various metrics, validated across multiple UAV perception benchmarks containing small objects under practical complex conditions.

Split-and-Shuffle Detector for Real-Time Traffic Object Detection in Aerial Image

Lightweight Network Learning with Zero-Shot Neural Architecture Search for UAV Images

Energy-Efficient Real-Time UAV Object Detection on Embedded Platforms

A Small UAV Detection Method Based on Optical Flow and Visual Feature Fusion

Fast Detection and Recognition Method of UAV in Sky Background

SG-Det: Shuffle-GhostNet-Based Detector for Real-Time Maritime Object Detection in UAV Images

A Low-Cost and Lightweight Real-Time Object-Detection Method Based on UAV Remote Sensing in Transportation Systems

Urban traffic tiny object detection via attention and multi-scale feature driven in UAV-vision

Self-Attention Guidance and Multiscale Feature Fusion-Based UAV Image Object Detection

SCCMDet: Adaptive Sparse Convolutional Networks Based on Class Maps for Real-Time Onboard Detection in Unmanned Aerial Vehicle Remote Sensing Images

Vehicle Detection from Road Image Sequences for Intelligent Traffic Scheduling

Development of Real-Time Unmanned Aerial Vehicle Urban Object Detection System with Federated Learning

Small-Object Detection for UAV-Based Images Using a Distance Metric Method

Object Detection Deployed on UAVs for Oblique Images by Fusing IMU Information

Object Detection for UAV Aerial Scenarios Based on Vectorized IOU

An Efficient UAV Image Object Detection Algorithm Based on Global Attention and Multi-Scale Feature Fusion

AF-DETR: efficient UAV small object detector via Assemble-and-Fusion mechanism

ISSD: Improved SSD for Insulator and Spacer Online Detection Based on UAV System

Efficient ConvNet-based Object Detection for Unmanned Aerial Vehicles by Selective Tile Processing

RSOD: Real-time small object detection algorithm in UAV-based traffic monitoring

Efficient Object Detection Model for Real-Time UAV Applications