Abstract:Object detection in Unmanned Aerial Vehicle (UAV) images has emerged as a focal area of research, which presents two significant challenges: i) objects are typically small and dense within vast images; ii) computational resource constraints render most models unsuitable for real-time deployment. Current real-time object detectors are not optimized for UAV images, and complex methods designed for small object detection often lack real-time capabilities. To address these challenges, we propose a novel detector, RemDet (Reparameter efficient multiplication Detector). Our contributions are as follows: 1) Rethinking the challenges of existing detectors for small and dense UAV images, and proposing information loss as a design guideline for efficient models. 2) We introduce the ChannelC2f module to enhance small object detection performance, demonstrating that high-dimensional representations can effectively mitigate information loss. 3) We design the GatedFFN module to provide not only strong performance but also low latency, effectively addressing the challenges of real-time detection. Our research reveals that GatedFFN, through the use of multiplication, is more cost-effective than feed-forward networks for high-dimensional representation. 4) We propose the CED module, which combines the advantages of ViT and CNN downsampling to effectively reduce information loss. It specifically enhances context information for small and dense objects. Extensive experiments on large UAV datasets, Visdrone and UAVDT, validate the real-time efficiency and superior performance of our methods. On the challenging UAV dataset VisDrone, our methods not only provided state-of-the-art results, improving detection by more than 3.4%, but also achieve 110 FPS on a single <a class="link-external link-http" href="http://4090.Codes" rel="external noopener nofollow">this http URL</a> are available at (this URL)(<a class="link-external link-https" href="https://github.com/HZAI-ZJNU/RemDet" rel="external noopener nofollow">this https URL</a>).

Energy-Efficient Real-Time UAV Object Detection on Embedded Platforms

E$^3$-UAV: An Edge-based Energy-Efficient Object Detection System for Unmanned Aerial Vehicles

Fast Detection and Recognition Method of UAV in Sky Background

Onboard Real-time Object Detection for UAV with Embedded NPU

A UAV-Based Energy-Efficient and Real-Time Object Detection System with Multi-Source Image Fusion

A Low-Cost and Lightweight Real-Time Object-Detection Method Based on UAV Remote Sensing in Transportation Systems

EUAVDet: an Efficient and Lightweight Object Detector for UAV Aerial Images with an Edge-Based Computing Platform

Efficient Object Detection Model for Real-Time UAV Applications

Using deep learning in an embedded system for real-time target detection based on images from an unmanned aerial vehicle: vehicle detection as a case study

A UAV aided lightweight target information collection and detection approach

Edge-Cloud Collaborative UAV Object Detection: Edge-Embedded Lightweight Algorithm Design and Task Offloading Using Fuzzy Neural Network

Towards Real-Time Fast Unmanned Aerial Vehicle Detection Using Dynamic Vision Sensors

Development of Real-Time Unmanned Aerial Vehicle Urban Object Detection System with Federated Learning

LWUAVDet: A Lightweight UAV Object Detection Network on Edge Devices

An Efficient FPGA Implementation for Real-Time and Low-Power UAV Object Detection

Super accurate low latency object detection on a surveillance UAV

Towards Real-Time Object Detection on Embedded Systems.

RemDet: Rethinking Efficient Model Design for UAV Object Detection

Lightweight Unmanned Aerial Vehicle Video Object Detection Based on Spatial-Temporal Correlation

Real-Time Object Detection Based on UAV Remote Sensing: A Systematic Literature Review