Abstract:Currently, the common used vision-based tracking system faces two major challenges: (1) the trade-off between speed and accuracy of the tracker; (2) the robustness of the tracking servo control. In this paper, we propose a new framework composed of a transformer attached to the siamese-type feature extraction networks called Siamese Transformer Network (SiamTrans) to balance the speed and accuracy, avoiding complicated hand-designed components and tedious post-processing of most existing siamese-type trackers with pre-defined anchor boxes or anchor-free schemes. SiamTrans forces the final set of predictions via bipartite matching, significantly reducing hyper-parameters associated with the candidate boxes. Moreover, to enhance the robustness of the servo control, the high-level control part is also redesigned by fusing all the bounding box information and with the Tracking Drift Suppression Strategy (TDSS). The TDSS is mainly used to judge the target’s loss. If the target is lost, it will feedback the previous information to reinitialize the tracker to track and update the template patch of SiamTrans, making the whole system more robust. Extensive experiments on visual tracking benchmarks, including GOT-10K, UAV123, demonstrate that SiamTrans achieves competitive performance and runs at 50 FPS. Specifically, SiamTrans outperforms the leading anchor-based tracker SiamRPN++ in the GOT-10K benchmark, confirming its effectiveness and efficiency. Furthermore, SiamTrans is deployed on the embedded device in which the algorithm can be run at 30FPS or 54FPS with TensorRT meeting the real-time requirements. In addition, we design the complete tracking system demo that can accurately track the target for multiple categories. The actual experimental results also show that the whole system is efficient and robust. The demo video link is as follows: https://youtu.be/UK37Q-M9ET4 .

EFTrack: A Lightweight Siamese Network for Aerial Object Tracking

Flow-Guided Single Object Tracking Framework in UAV Aerial Video

SiamOHOT: A Lightweight Dual Siamese Network for Onboard Hyperspectral Object Tracking Via Joint Spatial-Spectral Knowledge Distillation

A Real-Time Siamese Tracker Deployed on UAVs

MobileTrack: Siamese Efficient Mobile Network for High‐speed UAV Tracking

Fast-Tracker 2.0: Improving Autonomy of Aerial Tracking with Active Vision and Human Location Regression.

Efficient Siamese Network for UAV Tracking

Light Siamese Network for Long-Term Onboard Aerial Tracking

Siamese Dense Pixel-Level Fusion Network for Real-Time UAV Tracking

SmallTrack: Wavelet Pooling and Graph Enhanced Classification for UAV Small Object Tracking.

Siamese Object Tracking for Unmanned Aerial Vehicle: A Review and Comprehensive Analysis

LightOcean: A Lightweight and Efficient Network for Real-time UAV Tracking.

SiamHSFT: A Siamese Network-Based Tracker with Hierarchical Sparse Fusion and Transformer for UAV Tracking.

Interframe Saliency Transformer and Lightweight Multidimensional Attention Network for Real-Time Unmanned Aerial Vehicle Tracking

Siamese Transformer Network: Building an Autonomous Real-Time Target Tracking System for UAV

Onboard Real-Time Aerial Tracking with Efficient Siamese Anchor Proposal Network

Learning Efficient Transformer Representation for Siamese Tracker to UAV.

A Location-Aware Siamese Network for High-Speed Visual Tracking

Siamese Anchor Proposal Network for High-Speed Aerial Tracking

Visual Object Tracking for Unmanned Aerial Vehicles Based on the Template-Driven Siamese Network

A Fast Dynamic Dim Target Tracking Approach for UAVs Using Improved Lightweight Siamese Networks