Abstract: Visual object tracking performance has been dramatically improved in recent years, but some severe challenges remain open, like distractors and occlusions. We suspect the reason is that the feature representations of the tracking targets are only expressively learned but not fully discriminatively modeled. In this paper, we propose a novel Instance-Aware Tracker (IAT) to explicitly excavate the discriminability of feature representations, which improves the classical visual tracking pipeline with an instance-level classifier. First, we introduce a contrastive learning mechanism to formulate the classification task, ensuring that every training sample could be uniquely modeled and be highly distinguishable from plenty of other samples. Besides, we design an effective negative sample selection scheme to contain various intra and inter classes in the instance classification branch. Furthermore, we implement two variants of the proposed IAT, including a video-level one and an object-level one. They realize the concept of \textbf{instance} in different granularity as videos and target bounding boxes, respectively. The former enhances the ability to recognize the target from the background while the latter boosts the discriminative power for mitigating the target-distractor dilemma. Extensive experimental evaluations on 8 benchmark datasets show that both two versions of the proposed IAT achieve leading results against state-of-the-art methods while running at 30FPS. Code will be available when it is published.

Visual Tracking Via Online Discriminative Multiple Instance Metric Learning

Mean Shift Tracking Based on Ensemble Multiple Instance Learning

Explicitly Modeling the Discriminability for Instance-Aware Visual Object Tracking

Object Tracking Method Based on Incrementally Updating Linear Discriminant Subspace

Multiple Instance Tracking Based on Hierarchical Maximizing Bag's Margin Boosting

Visual Tracking with Online Structural Similarity-Based Weighted Multiple Instance Learning

Online Metric-Weighted Linear Representations for Robust Visual Tracking

Distractor-aware discrimination learning for online multiple object tracking

Object-Level Pseudo-3D Lifting for Distance-Aware Tracking

Multi-object tracking via discriminative appearance modeling.

Instance Segmentation Enabled Hybrid Data Association and Discriminative Hashing for Online Multi-Object Tracking

Special Issue on Visual Tracking

Object Tracking with Multi-View Support Vector Machines.

Visual Tracking Jointly with Online and Offline Learning

Discriminative and Robust Online Learning for Siamese Visual Tracking

Multiple Human Tracking Based on Multi-view Upper-Body Detection and Discriminative Learning

Online Multi-Expert Learning for Visual Tracking.

Deep Metric Learning for Visual Tracking

Online multiple object tracking based on fusing global and partial features

Visual Tracker Using Sequential Bayesian Learning: Discriminative, Generative, and Hybrid

Online Visual Multi-Object Tracking via Labeled Random Finite Set Filtering