Abstract:Visual tracking has made significant strides due to the adoption of transformer-based models. Most state-of-the-art trackers struggle to meet real-time processing demands on mobile platforms with constrained computing resources, particularly for real-time unmanned aerial vehicle (UAV) tracking. To achieve a better balance between performance and efficiency, we introduce AVTrack, an adaptive computation framework designed to selectively activate transformer blocks for real-time UAV tracking. The proposed Activation Module (AM) dynamically optimizes the ViT architecture by selectively engaging relevant components, thereby enhancing inference efficiency without significant compromise to tracking performance. Furthermore, to tackle the challenges posed by extreme changes in viewing angles often encountered in UAV tracking, the proposed method enhances ViTs' effectiveness by learning view-invariant representations through mutual information (MI) maximization. Two effective design principles are proposed in the AVTrack. Building on it, we propose an improved tracker, dubbed AVTrack-MD, which introduces the novel MI maximization-based multi-teacher knowledge distillation (MD) framework. It harnesses the benefits of multiple teachers, specifically the off-the-shelf tracking models from the AVTrack, by integrating and refining their outputs, thereby guiding the learning process of the compact student network. Specifically, we maximize the MI between the softened feature representations from the multi-teacher models and the student model, leading to improved generalization and performance of the student model, particularly in noisy conditions. Extensive experiments on multiple UAV tracking benchmarks demonstrate that AVTrack-MD not only achieves performance comparable to the AVTrack baseline but also reduces model complexity, resulting in a significant 17\% increase in average tracking speed.

UAV-Ground Visual Tracking: A Unified Dataset and Collaborative Learning Approach

Flow-Guided Single Object Tracking Framework in UAV Aerial Video

The Unmanned Aerial Vehicle Benchmark: Object Detection and Tracking

WebUAV-3 M: A Benchmark for Unveiling the Power of Million-Scale Deep UAV Tracking

WebUAV-3M: A Benchmark for Unveiling the Power of Million-Scale Deep UAV Tracking

Visible-Thermal UAV Tracking: A Large-Scale Benchmark and New Baseline

Multi-Target Tracking with Multiple Unmanned Aerial Vehicles Based on Information Fusion

UGV-UAV Cooperative 3D Multi-Object Tracking Based on Multi-Source Data Fusion

The Unmanned Aerial Vehicle Benchmark: Object Detection, Tracking and Baseline

UAVSwarm Dataset: An Unmanned Aerial Vehicle Swarm Dataset for Multiple Object Tracking

Vision-Based Anti-UAV Detection and Tracking

SGDViT: Saliency-Guided Dynamic Vision Transformer for UAV Tracking

Towards Robust Visual Tracking for Unmanned Aerial Vehicle with Tri-Attentional Correlation Filters

TrackingMamba: Visual State Space Model for Object Tracking

Learning Adaptive and View-Invariant Vision Transformer with Multi-Teacher Knowledge Distillation for Real-Time UAV Tracking

Joint Response and Background Learning for UAV Visual Tracking

Visual Ground Target Tracking of Unmanned Aerial Vehicle Based on Target Motion Model

Anti-UAV: A Large-Scale Benchmark for Vision-Based UAV Tracking

Correlation Filter-Based Visual Tracking for UAV with Online Multi-Feature Learning

A Benchmark for UAV-View Natural Language-Guided Tracking

Robust Scalable Part-Based Visual Tracking for UAV with Background-Aware Correlation Filter.