Abstract:High computational power and significant time are usually needed to train a deep learning based tracker on large datasets. Depending on many factors, training might not always be an option. In this paper, we propose a framework with two ideas on Siamese-based trackers. (i) Extending number of templates in a way that removes the need to retrain the network and (ii) a lightweight temporal network with a novel architecture focusing on both local and global information that can be used independently from trackers. Most Siamese-based trackers only rely on the first frame as the ground truth for objects and struggle when the target's appearance changes significantly in subsequent frames in presence of similar distractors. Some trackers use multiple templates which mostly rely on constant thresholds to update, or they replace those templates that have low similarity scores only with more similar ones. Unlike previous works, we use adaptive thresholds that update the bag with similar templates as well as those templates which are slightly diverse. Adaptive thresholds also cause an overall improvement over constant ones. In addition, mixing feature maps obtained by each template in the last stage of networks removes the need to retrain trackers. Our proposed lightweight temporal network, CombiNet, learns the path history of different objects using only object coordinates and predicts target's potential location in the next frame. It is tracker independent and applying it on new trackers does not need further training. By implementing these ideas, trackers' performance improved on all datasets tested on, including LaSOT, LaSOT extension, TrackingNet, OTB100, OTB50, UAV123 and UAV20L. Experiments indicate the proposed framework works well with both convolutional and transformer-based trackers. The official python code for this paper will be publicly available upon publication.

Distillation, Ensemble and Selection for building a Better and Faster Siamese based Tracker

Distilled Siamese Networks for Visual Tracking

Adaptive distractor-aware for siamese tracking via enhancement confidence evaluator

Distractor-aware Siamese Networks for Visual Object Tracking

Siamese Attentional Cascade Keypoints Network for Visual Object Tracking

Real-time object tracking in the wild with Siamese network

Improving Siamese Based Trackers with Light or No Training through Multiple Templates and Temporal Network

Tracking in tracking: An efficient method to solve the tracking distortion

The Multi-task Fully Convolutional Siamese Network with Correlation Filter Layer for Real-Time Visual Tracking

Object Tracking Algorithm Based on Channel-interconnection-spatial Attention Mechanism and Siamese Region Proposal Network

Siamese Residual Network for Efficient Visual Tracking

NCSiam: Reliable Matching Via Neighborhood Consensus for Siamese-Based Object Tracking.

Nocal-Siam: Refining Visual Features and Response With Advanced Non-Local Blocks for Real-Time Siamese Tracking

Siamese Tracking Network with Multi-attention Mechanism

Adaptive Siamese Tracking with a Compact Latent Network

Faster and Simpler Siamese Network for Single Object Tracking

Light Siamese Network for Long-Term Onboard Aerial Tracking

SiamFC++: Towards Robust and Accurate Visual Tracking with Target Estimation Guidelines

Siamese Instance Search for Tracking

A Spatial-Aware Tracker

SiamBAN: Target-Aware Tracking With Siamese Box Adaptive Network