Abstract:Visual object tracking is a key technology that is used in unmanned aerial vehicles (UAVs) to achieve autonomous navigation. In recent years, with the rapid development of deep learning, tracking algorithms based on Siamese neural networks have received widespread attention. However, because of complex and diverse tracking scenarios, as well as limited computational resources, most existing tracking algorithms struggle to ensure real-time stable operation while improving tracking performance. Therefore, studying efficient and fast-tracking frameworks, and enhancing the ability of algorithms to respond to complex scenarios has become crucial. Therefore, this paper proposes a cross-parallel attention and efficient match transformer for aerial tracking (SiamEMT). Firstly, we carefully designed the cross-parallel attention mechanism to encode global feature information and to achieve cross-dimensional interaction and feature correlation aggregation via parallel branches, highlighting feature saliency and reducing global redundancy information, as well as improving the tracking algorithm's ability to distinguish between targets and backgrounds. Meanwhile, we implemented an efficient match transformer to achieve feature matching. This network utilizes parallel, lightweight, multi-head attention mechanisms to pass template information to the search region features, better matching the global similarity between the template and search regions, and improving the algorithm's ability to perceive target location and feature information. Experiments on multiple drone public benchmark tests verified the accuracy and robustness of the proposed tracker in drone tracking scenarios. In addition, on the embedded artificial intelligence (AI) platform AGX Xavier, our algorithm achieved real-time tracking speed, indicating that our algorithm can be effectively applied to UAV tracking scenarios.

Siamese Transformer Network: Building an Autonomous Real-Time Target Tracking System for UAV

Beyond Traditional Driving Scenes: A Robotic-Centric Paradigm for 2D+3D Human Tracking Using Siamese Transformer Network

TransTracking for UAV: An Autonomous Real-time Target Tracking System for UAV via Transformer Tracking

Multi-modal 3D Human Tracking for Robots in Complex Environment with Siamese Point-Video Transformer

Flow-Guided Single Object Tracking Framework in UAV Aerial Video

SiamHSFT: A Siamese Network-Based Tracker with Hierarchical Sparse Fusion and Transformer for UAV Tracking.

A Real-Time Siamese Tracker Deployed on UAVs

Interframe Saliency Transformer and Lightweight Multidimensional Attention Network for Real-Time Unmanned Aerial Vehicle Tracking

Learning Efficient Transformer Representation for Siamese Tracker to UAV.

SiamHOT: Siamese High-Order Transformer for Aerial Tracking

Transformer-based Moving Target Tracking Method for Unmanned Aerial Vehicle

MobileTrack: Siamese Efficient Mobile Network for High‐speed UAV Tracking

Self-Prompting Tracking: A Fast and Efficient Tracking Pipeline for UAV Videos

SiamHAS: Siamese Tracker with Hierarchical Attention Strategy for Aerial Tracking

Siamese Dense Pixel-Level Fusion Network for Real-Time UAV Tracking

SGDViT: Saliency-Guided Dynamic Vision Transformer for UAV Tracking

Siamese Object Tracking for Unmanned Aerial Vehicle: A Review and Comprehensive Analysis

Learning Motion Blur Robust Vision Transformers with Dynamic Early Exit for Real-Time UAV Tracking

UnifiedTT: Visual Tracking with unified Transformer

Cross-Parallel Attention and Efficient Match Transformer for Aerial Tracking

Propagating Prior Information with Transformer for Robust Visual Object Tracking