Abstract:Unsupervised learning has been popular in various computer vision tasks, including visual object tracking. However, prior unsupervised tracking approaches rely heavily on spatial supervision from template-search pairs and are still unable to track objects with strong variation over a long time span. As unlimited self-supervision signals can be obtained by tracking a video along a cycle in time, we investigate evolving a Siamese tracker by tracking videos forward-backward. We present a novel unsupervised tracking framework, in which we can learn temporal correspondence both on the classification branch and regression branch. Specifically, to propagate reliable template feature in the forward propagation process so that the tracker can be trained in the cycle, we first propose a consistency propagation transformation. We then identify an ill-posed penalty problem in conventional cycle training in backward propagation process. Thus, a differentiable region mask is proposed to select features as well as to implicitly penalize tracking errors on intermediate frames. Moreover, since noisy labels may degrade training, we propose a mask-guided loss reweighting strategy to assign dynamic weights based on the quality of pseudo labels. In extensive experiments, our tracker outperforms preceding unsupervised methods by a substantial margin, performing on par with supervised methods on large-scale datasets such as TrackingNet and LaSOT. Code is available at <a class="link-external link-https" href="https://github.com/FlorinShum/ULAST" rel="external noopener nofollow">this https URL</a>.

Semi-supervised ensemble tracking

Semi-supervised Particle Filter for Visual Tracking

Mean Shift Tracking Based on Ensemble Multiple Instance Learning

Visual Tracking Using Online Semi-Supervised Learning

Robust Object Tracking with a Hierarchical Ensemble Framework

The improved particle filter for object tracking

Enhancing Particle Swarm Optimization Based Particle Filter Tracker

Embedding Ensemble Tracking in a Stochastic Framework for Robust Object Tracking

Visual Contour Tracking Based on Inner-contour Particle Filter

Efficient Particle Filter and Its Application in Contour Tracking

Vehicle Tracking Based on Co-Learning Particle Filter

A Bayesian Detect to Track System for Robust Visual Object Tracking and Semi-Supervised Model Learning

Online Unsupervised Feature Learning for Visual Tracking

Unsupervised Deep Representation Learning for Real-Time Tracking

Object Tracking Via Collaborative Multi-Task Learning and Appearance Model Updating

Adaptive Tracking Algorithm Based on Particle Grouped Optimization

Unsupervised Learning of Accurate Siamese Tracking

Collecting Consistently High Quality Object Tracks with Minimal Human Involvement by Using Self-Supervised Learning to Detect Tracker Errors

Unsupervised Deep Tracking

Ensemble Tracking Based on Diverse Collaborative Framework With Multi-Cue Dynamic Fusion

AdaBoost Tracker Embedded in Particle Filtering