Abstract:This article presents a semantic tracker which simultaneously tracks a single target and recognises its category. In general, it is hard to design a tracking model suitable for all object categories, e.g., a rigid tracker for a car is not suitable for a deformable gymnast. Category-based trackers usually achieve superior tracking performance for the objects of that specific category, but have difficulties being generalised. Therefore, we propose a novel unified robust tracking framework which explicitly encodes both generic features and category-based features. The tracker consists of a shared convolutional network (NetS), which feeds into two parallel networks, NetC for classification and NetT for tracking. NetS is pre-trained on ImageNet to serve as a generic feature extractor across the different object categories for NetC and NetT. NetC utilises those features within fully connected layers to classify the object category. NetT has multiple branches, corresponding to multiple categories, to distinguish the tracked object from the background. Since each branch in NetT is trained by the videos of a specific category or groups of similar categories, NetT encodes category-based features for tracking. During online tracking, NetC and NetT jointly determine the target regions with the right category and foreground labels for target estimation. To improve the robustness and precision, NetC and NetT inter-supervise each other and trigger network adaptation when their outputs are ambiguous for the same image regions (i.e., when the category label contradicts the foreground/background classification). We have compared the performance of our tracker to other state-of-the-art trackers on a large-scale tracking benchmark (100 sequences)---the obtained results demonstrate the effectiveness of our proposed tracker as it outperformed other 38 state-of-the-art tracking algorithms.

Uncertain motion tracking based on convolutional net with semantics estimation and region proposals

Uncertain motion tracking via target-objectness proposal and memory validation

Beyond Local Search: Tracking Objects Everywhere with Instance-Specific Proposals

TLPG-Tracker: Joint Learning of Target Localization and Proposal Generation for Visual Tracking.

Semantic tracking: Single-target tracking with inter-supervised convolutional networks

Tracking Randomly Moving Objects on Edge Box Proposals

Semantics-Aware Visual Object Tracking

Robust Tracking via Uncertainty-Aware Semantic Consistency

Robust Estimation of Similarity Transformation for Visual Object Tracking

Region-based High-resolution Siamese Network for Robust Visual Tracking

Inteval Spatio-Temporal Constraints and Pixel-Spatial Hierarchy Region Proposals for Abrupt Motion Tracking

An object tracking framework with recapture based on correlation filters and Siamese networks

Adaptive Region Proposal With Channel Regularization for Robust Object Tracking

A Bayesian Detect to Track System for Robust Visual Object Tracking and Semi-Supervised Model Learning

A Hybrid Visual Tracking Algorithm Based on SOM Network and Correlation Filter

Motion-Driven Tracking via End-to-End Coarse-to-Fine Verifying

Exploiting Weak Mask Representation with Convolutional Neural Networks for Accurate Object Tracking.

Object Tracking Algorithm Based on Channel-interconnection-spatial Attention Mechanism and Siamese Region Proposal Network

Online Video Tracking Using Collaborative Convolutional Networks

CRTrack: Learning Correlation-Refine network for visual object tracking

Robust Visual Tracking Via Collaborative and Reinforced Convolutional Feature Learning