Abstract:Visual object tracking algorithms based on Siamese networks yield promising results through offline training on large benchmarks. However, they cannot adapt well to changes in the target’s appearance and tracking scenarios during online tracking because they rely on a single initial template. Most existing template update algorithms use the tracking result of the previous frame to update the template. If the tracking results deteriorate, it can cause the tracker to accumulate incorrect templates, leading to tracking drift. In this work, we proposed a dynamic template updating Siamese network called dynamic template updating (DTU)-Track that utilizes status feedback with quality evaluation for visual object tracking. This network dynamically selects the tracking template for the next frame based on feedback from the tracking result of the previous frame. It calculates the updating quality score and tracking quality score by using the tracking result of the previous frame. The updating quality score determines whether the current tracking result can be stored in the template library. The tracking quality score quantifies the quality of the tracking status of the previous frame. The quality conversion module determines the number of templates required for the next frame by evaluating the tracking quality of the previous frame. The template extraction mechanism selects high-quality, diverse templates from the template library, thereby enabling the tracker to effectively adapt to changes in tracking scenarios and target’s appearance in the subsequent frame. Extensive experiments on large-scale benchmarks, such as OTB-2015, UAV123, GOT-10k, TrackingNet, and LaSOT, demonstrated our method’s superiority over other algorithms in various tracking scenarios, yielding a real-time speed of 36 FPS.

A New Template Update Scheme for Visual Tracking

High-speed Tracking with Multi-Templates Correlation Filters

The improved particle filter for object tracking

BackTrack: Robust template update via Backward Tracking of candidate template

Adaptive Model Update Strategy for Correlation Filter Trackers.

Enhancing Particle Swarm Optimization Based Particle Filter Tracker

Dynamic template updating Siamese network based on status feedback with quality evaluation for visual object tracking

Effective template update mechanism in visual tracking with background clutter

A Template-Drift-Resistant Object Tracking Algorithm

Robust Visual Tracking Revisited: From Correlation Filter to Template Matching

Tracking Algorithm of Dual Template Adaptive Updating Based on Multiple Features

AtptTrack: Asymmetric Transformer Tracker With Prior Templates

A Collaborative Feature Learning Method for Accurate and Robust Tracking

Robust Object Tracking Against Template Drift

Learning to Update for Object Tracking with Recurrent Meta-learner

Beyond Local Search: Tracking Objects Everywhere with Instance-Specific Proposals

Particle swarm optimization–Markov Chain Monte Carlo for accurate visual tracking with adaptive template update

Occlusion-Aware Visual Object Tracking Based on Multi-template Updating Siamese Network

Tracking Randomly Moving Objects on Edge Box Proposals

Multi-features Guided Robust Visual Tracking.

Visual Object Tracking with Adaptive Template Update and Global Search Augmentation