Abstract:A novel visual object tracking scheme is proposed by using joint point feature correspondences and object appearance similarity. For point feature-based tracking, we propose a candidate tracker that simultaneously exploits two separate sets of point feature correspondences in the foreground and in the surrounding background, where background features are exploited for the indication of occlusions. Feature points in these two sets are then dynamically maintained. For object appearance-based tracking, we propose a candidate tracker based on an enhanced anisotropic mean shift with a fully tunable (five degrees of freedom) bounding box that is partially guided by the above feature point tracker. Both candidate trackers contain a reinitialization process to reset the tracker in order to prevent accumulated tracking error propagation in frames. In addition, a novel online learning method is introduced to the enhanced mean shift-based candidate tracker. The reference object distribution is updated in each time interval if there is an indication of stable and reliable tracking without background interferences. By dynamically updating the reference object model, tracking is further improved by using a more accurate object appearance similarity measure. An optimal selection criterion is applied to the final tracker based on the results of these candidate trackers. Experiments have been conducted on several videos containing a range of complex scenarios. To evaluate the performance, the proposed scheme is further evaluated using three objective criteria, and compared with two existing trackers. All our results have shown that the proposed scheme is very robust and has yielded a marked improvement in terms of tracking drift, tightness, and accuracy of tracked bounding boxes, especially for complex video scenarios containing long-term partial occlusions or intersections, deformation, or background clutter with similar color distributions to the foreground object.

A Combined Visual Tracker Based on Global Appearance and Local Features

Robust Visual Tracking Via CAMShift and Structural Local Sparse Appearance Model

Multi-features Guided Robust Visual Tracking.

Visual Object Tracking Based on Combination of Local Description and Global Representation

Joint Feature Correspondences and Appearance Similarity for Robust Visual Object Tracking

A Robust Part-Based Tracker

Robust visual tracking combining global and local appearance models.

Visual obj ect tracking based on collaborative model using multiple features

Language-guided Dual-modal Local Correspondence for Single Object Tracking

Object Tracking Using Local Multiple Features And A Posterior Probability Measure

Learning Collaborative Model for Visual Tracking

Dual Integration of Multi‐model with Spatial‐temporal Occlusion‐awareness for Visual Object Tracking

MM-Tracker: Visual Tracking with A Multi-Task Model Integrating Detection and Differentiating Feature Extraction

Robust Tracking Via Patch-Based Appearance Model and Local Background Estimation

A Visual Tracking Algorithm Via Confidence-Based Multi-Feature Correlation Filtering.

Visual Object Tracking Via Guessing and Matching

Local to Global Tracker: A Siamese Network for Long-term Tracking

Collaborative Strategy for Visual Object Tracking

Multiple object tracking with appearance feature prediction and similarity fusion

Object Tracking Via a Cooperative Appearance Model

Robust Visual Tracking Method via Deep Learning