Abstract:Drone aerial imaging has become increasingly important across numerous fields as drone optical sensor technology continues to advance. One critical challenge in this domain is achieving both accurate and efficient multi-object tracking. Traditional deep learning methods often separate object identification from tracking, leading to increased complexity and potential performance degradation. Conventional approaches rely heavily on manual feature engineering and intricate algorithms, which can further limit efficiency. To overcome these limitations, we propose a novel Transformer-based end-to-end multi-object tracking framework. This innovative method leverages self-attention mechanisms to capture complex inter-object relationships, seamlessly integrating object detection and tracking into a unified process. By utilizing end-to-end training, our approach simplifies the tracking pipeline, leading to significant performance improvements. A key innovation in our system is the introduction of a trajectory detection label matching technique. This technique assigns labels based on a comprehensive assessment of object appearance, spatial characteristics, and Gaussian features, ensuring more precise and logical label assignments. Additionally, we incorporate cross-frame self-attention mechanisms to extract long-term object properties, providing robust information for stable and consistent tracking. We further enhance tracking performance through a newly developed self-characteristics module, which extracts semantic features from trajectory information across both current and previous frames. This module ensures that the long-term interaction modules maintain semantic consistency, allowing for more accurate and continuous tracking over time. The refined data and stored trajectories are then used as input for subsequent frame processing, creating a feedback loop that sustains tracking accuracy. Extensive experiments conducted on the VisDrone and UAVDT datasets demonstrate the superior performance of our approach in drone-based multi-object tracking.

Real-Time Object Tracking on a Drone With Multi-Inertial Sensing Data

Fast-Tracker 2.0: Improving Autonomy of Aerial Tracking with Active Vision and Human Location Regression.

Online Multi-Object Tracking from A Bird's-Eye View by Fusion of Millimeter-Wave Radar and Vision

Real-Time Object Localization Using a Fuzzy Controller for a Vision-Based Drone

Onboard dynamic-object detection and tracking for autonomous robot navigation with RGB-D camera

Deep Learning-Based Real-Time Multiple-Object Detection and Tracking from Aerial Imagery via a Flying Robot with GPU-Based Embedded Devices

REDBEE: A Visual-Inertial Drone System for Real-Time Moving Object Detection

A Vision-based UAV Tracker Aiming at Aerial Targets

End-to-end multiple object tracking in high-resolution optical sensors of drones with transformer models

Real-Time Visual Tracking of Moving Targets Using a Low-Cost Unmanned Aerial Vehicle with a 3-Axis Stabilized Gimbal System

Tiny Drone Tracking Framework Using Multiple Trackers and Kalman-based Predictor

DroneTrack: Cloud-Based Real-Time Object Tracking Using Unmanned Aerial Vehicles Over the Internet

Multitarget Real-Time Tracking Algorithm for UAV IoT

Deep Learning based Multi-Modal Sensing for Tracking and State Extraction of Small Quadcopters

Eye in the Sky: Drone-Based Object Tracking and 3D Localization

DroneMOT: Drone-based Multi-Object Tracking Considering Detection Difficulties and Simultaneous Moving of Drones and Objects

On Onboard LiDAR-based Flying Object Detection

Visual Object Tracking for A Nano-scale Quadrotor

FlyTracker: Motion Tracking and Obstacle Detection for Drones Using Event Cameras.

Event-Based Motion Capture System for Online Multi-Quadrotor Localization and Tracking

Adaptive Tracking and Perching for Quadrotor in Dynamic Scenarios