Abstract:Drone aerial imaging has become increasingly important across numerous fields as drone optical sensor technology continues to advance. One critical challenge in this domain is achieving both accurate and efficient multi-object tracking. Traditional deep learning methods often separate object identification from tracking, leading to increased complexity and potential performance degradation. Conventional approaches rely heavily on manual feature engineering and intricate algorithms, which can further limit efficiency. To overcome these limitations, we propose a novel Transformer-based end-to-end multi-object tracking framework. This innovative method leverages self-attention mechanisms to capture complex inter-object relationships, seamlessly integrating object detection and tracking into a unified process. By utilizing end-to-end training, our approach simplifies the tracking pipeline, leading to significant performance improvements. A key innovation in our system is the introduction of a trajectory detection label matching technique. This technique assigns labels based on a comprehensive assessment of object appearance, spatial characteristics, and Gaussian features, ensuring more precise and logical label assignments. Additionally, we incorporate cross-frame self-attention mechanisms to extract long-term object properties, providing robust information for stable and consistent tracking. We further enhance tracking performance through a newly developed self-characteristics module, which extracts semantic features from trajectory information across both current and previous frames. This module ensures that the long-term interaction modules maintain semantic consistency, allowing for more accurate and continuous tracking over time. The refined data and stored trajectories are then used as input for subsequent frame processing, creating a feedback loop that sustains tracking accuracy. Extensive experiments conducted on the VisDrone and UAVDT datasets demonstrate the superior performance of our approach in drone-based multi-object tracking.

Separation Fusion Transformer and Efficient Reuse Matching Network for Aerial Tracking

Flow-Guided Single Object Tracking Framework in UAV Aerial Video

Adaptive Switching Spatial-Temporal Fusion Detection for Remote Flying Drones

Fast-Tracker 2.0: Improving Autonomy of Aerial Tracking with Active Vision and Human Location Regression.

SiamHSFT: A Siamese Network-Based Tracker with Hierarchical Sparse Fusion and Transformer for UAV Tracking.

A Unified Transformer-based Tracker for Anti-UAV Tracking

Siamese Transformer Network: Building an Autonomous Real-Time Target Tracking System for UAV

Modality Meets Long-Term Tracker: A Siamese Dual Fusion Framework for Tracking UAV

Cross-Parallel Attention and Efficient Match Transformer for Aerial Tracking

Interframe Saliency Transformer and Lightweight Multidimensional Attention Network for Real-Time Unmanned Aerial Vehicle Tracking

EFTrack: A Lightweight Siamese Network for Aerial Object Tracking

End-to-end multiple object tracking in high-resolution optical sensors of drones with transformer models

TFITrack: Transformer Feature Integration Network for Object Tracking

Adaptive and Background-Aware Vision Transformer for Real-Time UAV Tracking

Transformer-based Moving Target Tracking Method for Unmanned Aerial Vehicle

Enhancing Online UAV Multi-Object Tracking with Temporal Context and Spatial Topological Relationships

Tracker Meets Night: A Transformer Enhancer for UAV Tracking

Learning Efficient Transformer Representation for Siamese Tracker to UAV.

MobileTrack: Siamese Efficient Mobile Network for High‐speed UAV Tracking

TrackingMamba: Visual State Space Model for Object Tracking

Learning Motion Blur Robust Vision Transformers with Dynamic Early Exit for Real-Time UAV Tracking