Abstract:Unmanned aerial vehicles (UAVs) have been popular in many commercial and industrial applications, but they also pose great threats to urban safety and aerial security. Intelligent UAV surveillance based on thermal infrared (TIR) imaging has attracted increasing attention for its long-range monitoring ability in both day and night scenarios. However, weak UAV target features, dynamically changing UAV states, and complex background interferences present serious challenges to the accurate tracking of UAVs. To tackle these problems, we propose a novel online multiscale infrared UAV target (IRUT) tracking network (SiamCAP) incorporating enhanced context feature awareness and pixel-wise attention modulation. We first introduce a novel contrast-enhanced multiscale online re-parameterization block (CMORB) to effectively extract contrast difference intensity information between the target and the background, and transform it into a single branch for both training and inference without introducing computational overhead. Then, we construct a feature fusion modulation module (FFMM) to guide cross-layer feature aggregation. It uses low-level attention to highlight the UAV target feature in the deep layer with the novel full spatial resolution channel attention (FSRCA), which calculates pixel-wise importance without dimensionality compression. Finally, we propose a cross-attention-based updatable feature interaction module (CUFIM) to model the correlation between online updating multitemplate and search frame, which improves the model's robustness to changes in the state of UAVs and complex backgrounds. Extensive experiments on real infrared UAV datasets demonstrate that the proposed approach outperforms the state-of-the-art (SOTA) target trackers under complex backgrounds while achieving a real-time tracking speed.

Alleviating Spatial Misalignment and Motion Interference for UAV-based Video Recognition

Multilevel Spatial-Temporal Feature Aggregation for Video Object Detection

Low in Resolution, High in Precision: UAV Detection with Super-Resolution and Motion Information Extraction

Flow-Guided Single Object Tracking Framework in UAV Aerial Video

Enhancing Online UAV Multi-Object Tracking with Temporal Context and Spatial Topological Relationships

MITFAS: Mutual Information based Temporal Feature Alignment and Sampling for Aerial Video Action Recognition

Multi-Target Tracking with Multiple Unmanned Aerial Vehicles Based on Information Fusion

A Video Object Detector with Spatio-Temporal Attention Module for Micro UAV Detection

Saliency-aware Spatio-temporal Modeling for Action Recognition on Unmanned Aerial Vehicles

Toward More Robust and Real-Time Unmanned Aerial Vehicle Detection and Tracking via Cross-Scale Feature Aggregation Based on the Center Keypoint.

Adaptive Feature Fusion and Improved Attention Mechanism-Based Small Object Detection for UAV Target Tracking

An Efficient Saliency Prediction Model for Unmanned Aerial Vehicle Video

UAV-Assisted Wide Area Multi-Camera Space Alignment Based on Spatiotemporal Feature Map

Semantic-Aware Dynamic Feature Selection and Fusion for Object Detection in UAV Videos.

Object Tracking in Unmanned Aerial Vehicle Videos via Multifeature Discrimination and Instance-Aware Attention Network

Online Infrared UAV Target Tracking with Enhanced Context-Awareness and Pixel-Wise Attention Modulation

Learning Spatio-Temporal Attention Based Siamese Network for Tracking UAVs in the Wild

Learnable Cross-Scale Sparse Attention Guided Feature Fusion for UAV Object Detection

Differentiated Attention Guided Network over Hierarchical and Aggregated Features for Intelligent UAV Surveillance

UCDNet: Multi-UAV Collaborative 3D Object Detection Network by Reliable Feature Mapping

Self-Attention Guidance and Multiscale Feature Fusion-Based UAV Image Object Detection