Abstract:A novel visual object tracking scheme is proposed by using joint point feature correspondences and object appearance similarity. For point feature-based tracking, we propose a candidate tracker that simultaneously exploits two separate sets of point feature correspondences in the foreground and in the surrounding background, where background features are exploited for the indication of occlusions. Feature points in these two sets are then dynamically maintained. For object appearance-based tracking, we propose a candidate tracker based on an enhanced anisotropic mean shift with a fully tunable (five degrees of freedom) bounding box that is partially guided by the above feature point tracker. Both candidate trackers contain a reinitialization process to reset the tracker in order to prevent accumulated tracking error propagation in frames. In addition, a novel online learning method is introduced to the enhanced mean shift-based candidate tracker. The reference object distribution is updated in each time interval if there is an indication of stable and reliable tracking without background interferences. By dynamically updating the reference object model, tracking is further improved by using a more accurate object appearance similarity measure. An optimal selection criterion is applied to the final tracker based on the results of these candidate trackers. Experiments have been conducted on several videos containing a range of complex scenarios. To evaluate the performance, the proposed scheme is further evaluated using three objective criteria, and compared with two existing trackers. All our results have shown that the proposed scheme is very robust and has yielded a marked improvement in terms of tracking drift, tightness, and accuracy of tracked bounding boxes, especially for complex video scenarios containing long-term partial occlusions or intersections, deformation, or background clutter with similar color distributions to the foreground object.

Joint Identification-Verification Model For Visual Tracking

Visual Tracking Based on Semantic and Similarity Learning

Supplementary Material: Quasi-Dense Similarity Learning for Multiple Object Tracking

Joint Spatio-Temporal Similarity and Discrimination Learning for Visual Tracking

Similarity learning for template-based visual tracking

Visual Target Tracking Based on Online Discriminant Feature Enhancement

Robust Visual Tracking Via Multiple Discriminative Models with Object Proposals

Joint Feature Correspondences and Appearance Similarity for Robust Visual Object Tracking

Comparative Object Similarity Learning-Based Robust Visual Tracking

Visual Tracking Algorithm Based on Online Feature Discrimination with Siamese Network

Joint spatio-temporal modeling for visual tracking

Explicitly Modeling the Discriminability for Instance-Aware Visual Object Tracking

Visual Tracking Via Discriminative Sparse Similarity Map

Exploring Reliable Visual Tracking Via Target Embedding Network

Learning Collaborative Model for Visual Tracking

Learning Deep Multi-Level Similarity for Thermal Infrared Object Tracking

Learning Spatially Regularized Similarity for Robust Visual Tracking.

Learning Fine-Grained Similarity Matching Networks for Visual Tracking

Similarity Fusion for Visual Tracking

Masked and Dynamic Siamese Network for Robust Visual Tracking.

Dual Integration of Multi‐model with Spatial‐temporal Occlusion‐awareness for Visual Object Tracking