Abstract:Unmanned aerial vehicles (UAVs) play an important role in conducting automatic patrol inspections of cities, which can ensure the safety of urban residents’ life and property and the normal operation of cities. However, during the inspection process, problems may arise. For example, numerous small objects in UAV images are difficult to detect, objects in UAV images are severely occluded, and requirements for real-time performances are posed. To address these issues, we first propose a real-time object detection network (RTD-Net) for UAV images. Besides, to deal with the lack of visual features of small objects, we design a feature fusion module (FFM) to interact and fuse features at different levels and improve the feature expression ability of small objects. To achieve real-time detection, we design a lightweight feature extraction module (LEM) to build the backbone network to control the calculation quantity and parameters. To solve the issue of discontinuous features of occluded objects, an efficient convolutional transformer block (ECTB)-based convolutional multihead self-attention (CMHSA) is designed to improve the recognition ability of occluded objects by extracting the context information of objects. Compared with multihead self-attention (MHSA) in the traditional transformer, CMHSA uses convolutional projection to replace the position-linear projection, which can reduce a large amount of calculation without performance loss. Finally, an attention prediction head (APH) is designed based on the attention mechanism to improve the ability of the model to extract attention regions in complex scenarios. The proposed method reaches a detection accuracy of 86.4% mean average precision (mAP) in our UAV image dataset. In addition, it achieves a detection accuracy of 86.0% mAP and a detection speed of 33.4 frames/s in the NVIDIA Jeston TX2 embedded device.

Onboard Real-time Object Detection for UAV with Embedded NPU

Energy-Efficient Real-Time UAV Object Detection on Embedded Platforms

Fast Detection and Recognition Method of UAV in Sky Background

A Low-Cost and Lightweight Real-Time Object-Detection Method Based on UAV Remote Sensing in Transportation Systems

LWUAVDet: A Lightweight UAV Object Detection Network on Edge Devices

Lightweight Unmanned Aerial Vehicle Video Object Detection Based on Spatial-Temporal Correlation

Using deep learning in an embedded system for real-time target detection based on images from an unmanned aerial vehicle: vehicle detection as a case study

FasterX: Real-Time Object Detection Based on Edge GPUs for UAV Applications

Efficient Object Detection Model for Real-Time UAV Applications

Detection of Military Targets on Ground and Sea by UAVs with Low-Altitude Oblique Perspective

Lightweight Detection Network Based on Sub-Pixel Convolution and Objectness-Aware Structure for UAV Images

A UAV aided lightweight target information collection and detection approach

Real-time Aerial Detection and Reasoning on Embedded-UAVs

Development of Real-Time Unmanned Aerial Vehicle Urban Object Detection System with Federated Learning

Small Object Detection in UAV Images Based on YOLOv8n

A Video Object Detector with Spatio-Temporal Attention Module for Micro UAV Detection

Coarse-to-fine object detection in unmanned aerial vehicle imagery using lightweight convolutional neural network and deep motion saliency

Enhancing UAV Visual Landing Recognition with YOLO's Object Detection by Onboard Edge Computing

Real-Time Object Detection Network in UAV-Vision Based on CNN and Transformer.

Edge-Cloud Collaborative UAV Object Detection: Edge-Embedded Lightweight Algorithm Design and Task Offloading Using Fuzzy Neural Network