Abstract:Although the performance of unmanned aerial vehicle (UAV) tracking has benefited from the successful application of discriminative correlation filters (DCF) and convolutional neural networks (CNNs), UAV tracking under occlusion and deformation remains a challenge. The main dilemma is that challenging scenes, such as occlusion or deformation, are very complex and changeable, making it difficult to obtain training data covering all situations, resulting in trained networks that may be confused by new contexts that differ from historical information. Data-driven strategies are the main direction of current solutions, but gathering large-scale datasets with object instances under various occlusion and deformation conditions is difficult and lacks diversity. This paper proposes an attention-based mask generation network (AMGN) for UAV-specific tracking, which combines the attention mechanism and adversarial learning to improve the tracker’s ability to handle occlusion and deformation. After the base CNN extracts the deep features of the candidate region, a series of masks are determined by the spatial attention module and sent to the generator, and the generator discards some features according to these masks to simulate the occlusion and deformation of the object, producing more hard positive samples. The discriminator seeks to distinguish these hard positive samples while guiding mask generation. Such adversarial learning can effectively complement occluded and deformable positive samples in the feature space, allowing to capture more robust features to distinguish objects from backgrounds. Comparative experiments show that our AMGN-based tracker achieves the highest area under curve (AUC) of 0.490 and 0.349, and the highest precision scores of 0.742 and 0.662, on the UAV123 tracking benchmark with partial and full occlusion attributes, respectively. It also achieves the highest AUC of 0.555 and the highest precision score of 0.797 on the DTB70 tracking benchmark with the deformation attribute. On the UAVDT tracking benchmark with the large occlusion attribute, it achieves the highest AUC of 0.407 and the highest precision score of 0.582.

An Anti-occlusion Correlation Filtering Tracking Algorithm for UAV

AO-AutoTrack: Anti-occlusion Real-Time UAV Tracking Based on Spatio-temporal Context

Correlation Filter of Multiple Candidates Match for Anti-Obscure Tracking in Unmanned Aerial Vehicle Scenario

Joint Learning Spatial-Temporal Attention Correlation Filters for Aerial Tracking

Anti-Occlusion Visual Tracking Algorithm for UAVs with Multi-Feature Adaptive Fusion

Learning Aberrance Repressed Correlation Filters for Real-Time UAV Tracking

Adaptive Gaussian-Like Response Correlation Filter for UAV Tracking

ARTracker: Compute a More Accurate and Robust Correlation Filter for UAV Tracking

Occlusion and Deformation Handling Visual Tracking for UAV Via Attention-Based Mask Generative Network.

Correlation Filter based on Trajectory Correction and Context Interference Suppression for Real-Time UAV Tracking

Spatial Reliability Enhanced Correlation Filter: an Efficient Approach for Real-Time UAV Tracking

Target Tracking Algorithm Combined Part-Based and Redetection for UAV

UAV Tracking via Saliency-Aware and Spatial–Temporal Regularization Correlation Filter Learning

Robust Correlation Tracking For Uav Videos Via Feature Fusion And Saliency Proposals

Robust Correlation Tracking in Unmanned Aerial Vehicle Videos via Deep Target-Specific Rectification Networks

Two-Space Spatial-Temporal Regularized Correlation Filters for UAV-Based Aerial Tracking

Adaptive Label-Constrained Correlation Filter for UAV Tracking

Learning Adaptive Spatial-Temporal Context-Aware Correlation Filters for UAV Tracking

Part-Based Background-Aware Tracking for UAV with Convolutional Features

Robust Scalable Part-Based Visual Tracking for UAV with Background-Aware Correlation Filter.

Unmanned Aerial Vehicle Object Tracking By Correlation Filter With Adaptive Appearance Model