Abstract:Object detection in Unmanned Aerial Vehicle (UAV) images has emerged as a focal area of research, which presents two significant challenges: i) objects are typically small and dense within vast images; ii) computational resource constraints render most models unsuitable for real-time deployment. Current real-time object detectors are not optimized for UAV images, and complex methods designed for small object detection often lack real-time capabilities. To address these challenges, we propose a novel detector, RemDet (Reparameter efficient multiplication Detector). Our contributions are as follows: 1) Rethinking the challenges of existing detectors for small and dense UAV images, and proposing information loss as a design guideline for efficient models. 2) We introduce the ChannelC2f module to enhance small object detection performance, demonstrating that high-dimensional representations can effectively mitigate information loss. 3) We design the GatedFFN module to provide not only strong performance but also low latency, effectively addressing the challenges of real-time detection. Our research reveals that GatedFFN, through the use of multiplication, is more cost-effective than feed-forward networks for high-dimensional representation. 4) We propose the CED module, which combines the advantages of ViT and CNN downsampling to effectively reduce information loss. It specifically enhances context information for small and dense objects. Extensive experiments on large UAV datasets, Visdrone and UAVDT, validate the real-time efficiency and superior performance of our methods. On the challenging UAV dataset VisDrone, our methods not only provided state-of-the-art results, improving detection by more than 3.4%, but also achieve 110 FPS on a single <a class="link-external link-http" href="http://4090.Codes" rel="external noopener nofollow">this http URL</a> are available at (this URL)(<a class="link-external link-https" href="https://github.com/HZAI-ZJNU/RemDet" rel="external noopener nofollow">this https URL</a>).

Towards Resolving the Challenge of Long-tail Distribution in UAV Images for Object Detection

DTSSNet: Dynamic Training Sample Selection Network for UAV Object Detection

Efficient and Accurate Giraffe-Det for UAV Image Based Object Detection

Multiclass Object Detection in UAV Images Based on Rotation Region Network

Self-Attention Guidance and Multiscale Feature Fusion-Based UAV Image Object Detection

A New Algorithm for Small Target Detection From the Perspective of Unmanned Aerial Vehicles

Object Detection for UAV Aerial Scenarios Based on Vectorized IOU

RemDet: Rethinking Efficient Model Design for UAV Object Detection

Multi-Branch Parallel Networks for Object Detection in High-Resolution UAV Remote Sensing Images

Object Detection in Drone Imagery Via Sample Balance Strategies and Local Feature Enhancement

A Temporal and Self-Attention Based Method for Small Object Detection in UAV Imagery

Small Object Detection Via Dual Inspection Mechanism for UAV Visual Images

A Modified YOLOv5 for Object Detection in UAV-captured Scenarios

A unified and costless approach for improving small and long-tail object detection in aerial images of traffic scenarios

A Modified YOLOv8 Detection Network for UAV Aerial Image Recognition

CDNet: Object Detection Based on Cross-Level Aggregation and Deformable Attention for UAV Aerial Images

Diminishing Domain Bias by Leveraging Domain Labels in Object Detection on UAVs

An Efficient Method for Detecting Dense and Small Objects in UAV Images

Delving into Robust Object Detection from Unmanned Aerial Vehicles: A Deep Nuisance Disentanglement Approach

Domain Feature Decomposition for Efficient Object Detection in Aerial Images