Abstract:Drone aerial imaging has become increasingly important across numerous fields as drone optical sensor technology continues to advance. One critical challenge in this domain is achieving both accurate and efficient multi-object tracking. Traditional deep learning methods often separate object identification from tracking, leading to increased complexity and potential performance degradation. Conventional approaches rely heavily on manual feature engineering and intricate algorithms, which can further limit efficiency. To overcome these limitations, we propose a novel Transformer-based end-to-end multi-object tracking framework. This innovative method leverages self-attention mechanisms to capture complex inter-object relationships, seamlessly integrating object detection and tracking into a unified process. By utilizing end-to-end training, our approach simplifies the tracking pipeline, leading to significant performance improvements. A key innovation in our system is the introduction of a trajectory detection label matching technique. This technique assigns labels based on a comprehensive assessment of object appearance, spatial characteristics, and Gaussian features, ensuring more precise and logical label assignments. Additionally, we incorporate cross-frame self-attention mechanisms to extract long-term object properties, providing robust information for stable and consistent tracking. We further enhance tracking performance through a newly developed self-characteristics module, which extracts semantic features from trajectory information across both current and previous frames. This module ensures that the long-term interaction modules maintain semantic consistency, allowing for more accurate and continuous tracking over time. The refined data and stored trajectories are then used as input for subsequent frame processing, creating a feedback loop that sustains tracking accuracy. Extensive experiments conducted on the VisDrone and UAVDT datasets demonstrate the superior performance of our approach in drone-based multi-object tracking.

Hybrid Convolutional-Transformer framework for drone-based few-shot weakly supervised object detection

DroneNet: Rescue Drone-View Object Detection

Real-Time Drone Detection Using Deep Learning Approach.

Low in Resolution, High in Precision: UAV Detection with Super-Resolution and Motion Information Extraction

Hybrid receptive field network for small object detection on drone view

Efficient YOLOv7-Drone: An Enhanced Object Detection Approach for Drone Aerial Imagery

DFS-DETR: Detailed-Feature-Sensitive Detector for Small Object Detection in Aerial Images Using Transformer

ATBHC-YOLO: Aggregate Transformer and Bidirectional Hybrid Convolution for Small Object Detection

A Small Object Detection Method for Drone-Captured Images Based on Improved YOLOv7

Learnable Cross-Scale Sparse Attention Guided Feature Fusion for UAV Object Detection

Drone-TOOD: A Lightweight Task-Aligned Object Detection Algorithm for Vehicle Detection in UAV Images

End-to-end multiple object tracking in high-resolution optical sensors of drones with transformer models

Learning-based Object Detection in High Resolution UAV Images - An Empirical Study.

SODCNN: A Convolutional Neural Network Model for Small Object Detection in Drone-Captured Images

Cross-Modal Object Detection via UAV

Small Object Detection in UAV Images Based on YOLOv8n

Fast and Accurate, Convolutional Neural Network Based Approach for Object Detection from UAV

Bridging the Gap Between Object Detection in Close-Up and High-Resolution Wide Shots

Drone Detection Method Based on MobileViT and CA-PANet

A context-scale-aware detector and a new benchmark for remote sensing small weak object detection in unmanned aerial vehicle images

Object Detection from the Video Taken by Drone via Convolutional Neural Networks