Abstract:SummaryIntelligent unmanned aerial vehicles (UAVs) are drawing more and more attention from industry to academia. UAV navigation plays an important role in the cooperative scenario where multiple UAVs are deployed, while image data that capture the information of the UAV area are often used as input for UAV navigation. Deep learning is a common and powerful technique for UAV image processing, but a complex model generated by deep learning technique is hardly suitable for the limited computing capacity of edge computing devices such as UAVs. Therefore, this paper designs an efficient deep learning model on UAVs to fit the restriction of low computational powers and low power consumption. Traditional UAV object detection methods mostly use static images as the basis for object recognition, or collect images for offline detection. Our method combines the existing fast single‐frame detection methods with the spatial‐temporal relationship of video sequences, to build an efficient end‐to‐end model. In addition, the convolutional LSTM module is used to propagate the temporal context of the video frame sequences. Based on the temporal context, we propose a module for calculating spatial correlation. At the same time, we establish our experimental dataset in our real application and conduct the experiment, which shows that the proposed method reduces the size of models and meanwhile maintains the detection rate. Compared with the existing static images approaches, our method is faster and more accurate. Inference speeds of nearly 20fps can be achieved while performing real‐time tasks.

Cascade Improved Visual Detection and Distance Estimation in Formation of Micro Unmanned Aerial Vehicles

A Small UAV Detection Method Based on Optical Flow and Visual Feature Fusion

Fast Detection and Recognition Method of UAV in Sky Background

Low in Resolution, High in Precision: UAV Detection with Super-Resolution and Motion Information Extraction

Vision-Based Formation Control Of A Heterogeneous Unmanned System

Traffic Collisions Early Warning Aided by Small Unmanned Aerial Vehicle Companion

Optimal Formation Control and Visual Simulation for Multiple Unmanned Aerial Vehicles (Uavs)

Multi-Target Tracking with Multiple Unmanned Aerial Vehicles Based on Information Fusion

Detection of Military Targets on Ground and Sea by UAVs with Low-Altitude Oblique Perspective

Target Detection Formulti-Uavs Via Digital Pheromones and Navigation Algorithm in Unknownenvironments

LiDAR Depth Cluster Active Detection and Localization for a UAV with Partial Information Loss in GNSS

Bidirectional Feedback of Optimized Gaussian Mixture Model and Kernel Correlation Filter for Enhancing Simple Detection of Small Pixel Vehicles.

A Vision-Only Relative Distance Calculation Method for Multi-UAV Systems

UAV formation flight based on vision sensor

Lightweight Unmanned Aerial Vehicle Video Object Detection Based on Spatial-Temporal Correlation

An Improved Cascade R-CNN-Based Target Detection Algorithm for UAV Aerial Images

A Vehicle-Mounted Radar-Vision System for Precisely Positioning Clustering UAVs

UAV Target Detection under Complex Sky Background

Vision-Based Distributed Formation Control of Unmanned Aerial Vehicles

Toward More Robust and Real-Time Unmanned Aerial Vehicle Detection and Tracking via Cross-Scale Feature Aggregation Based on the Center Keypoint.

Real-Time Multi-Modal Active Vision for Object Detection on UAVs Equipped With Limited Field of View LiDAR and Camera