Abstract:In recent years, UAV technology has developed rapidly. Due to the mobility, low cost, and variable monitoring altitude of UAVs, multiple-object detection and tracking in aerial videos has become a research hotspot in the field of computer vision. However, due to camera motion, small target size, target adhesion, and unpredictable target motion, it is still difficult to detect and track targets of interest in aerial videos, especially in the case of a low frame rate where the target position changes too much. In this paper, we propose a multiple-object-tracking algorithm based on dense-trajectory voting in aerial videos. The method models the multiple-target-tracking problem as a voting problem of the dense-optical-flow trajectory to the target ID, which can be applied to aerial-surveillance scenes and is robust to low-frame-rate videos. More specifically, we first built an aerial video dataset for vehicle targets, including a training dataset and a diverse test dataset. Based on this, we trained the neural network model by using a deep-learning method to detect vehicles in aerial videos. Thereafter, we calculated the dense optical flow in adjacent frames, and generated effective dense-optical-flow trajectories in each detection bounding box at the current time. When target IDs of optical-flow trajectories are known, the voting results of the optical-flow trajectories in each detection bounding box are counted. Finally, similarity between detection objects in adjacent frames was measured based on the voting results, and tracking results were obtained by data association. In order to evaluate the performance of this algorithm, we conducted experiments on self-built test datasets. A large number of experimental results showed that the proposed algorithm could obtain good target-tracking results in various complex scenarios, and performance was still robust at a low frame rate by changing the video frame rate. In addition, we carried out qualitative and quantitative comparison experiments between the algorithm and three state-of-the-art tracking algorithms, which further proved that this algorithm could not only obtain good tracking results in aerial videos with a normal frame rate, but also had excellent performance under low-frame-rate conditions.

Conditional GAN Based Individual and Global Motion Fusion for Multiple Object Tracking in UAV Videos

Flow-Guided Single Object Tracking Framework in UAV Aerial Video

Online Multi-Object Tracking from A Bird's-Eye View by Fusion of Millimeter-Wave Radar and Vision

Multi-Object Tracking Meets Moving UAV

Cooperative Trajectory Prediction of UAVs via Generative Adversarial Networks

Multi-object tracking in UAVs with feature fusion distribution and occlusion awareness

Enhanced Multi-Object Tracking: Inferring Motion States of Tracked Objects

MM-Tracker: Motion Mamba with Margin Loss for UAV-platform Multiple Object Tracking

STCMOT: Spatio-Temporal Cohesion Learning for UAV-Based Multiple Object Tracking

Effective Motion Modeling for UAV-platform Multiple Object Tracking with Re-Margin Loss

Enhancing Online UAV Multi-Object Tracking with Temporal Context and Spatial Topological Relationships

Multi-object tracking with deep learning ensemble for unmanned aerial system applications

High-Performance Detection-Based Tracker for Multiple Object Tracking in UAVs

Hybrid Dual-Scale Neural Network Model for Tracking Complex Maneuvering UAVs

Global-Local and Occlusion Awareness Network for Object Tracking in UAVs

Onboard Robust Visual Tracking for UAVs Using a Reliable Global-Local Object Model

Multiple object detection and tracking from drone videos based on GM-YOLO and multi-tracker

Occlusion and Deformation Handling Visual Tracking for UAV Via Attention-Based Mask Generative Network.

Multiple-Object-Tracking Algorithm Based On Dense Trajectory Voting In Aerial Videos

Self-balance Motion and Appearance Model for Multi-object Tracking in UAV.

View-Centric Multi-Object Tracking with Homographic Matching in Moving UAV