Abstract:A novel visual object tracking scheme is proposed by using joint point feature correspondences and object appearance similarity. For point feature-based tracking, we propose a candidate tracker that simultaneously exploits two separate sets of point feature correspondences in the foreground and in the surrounding background, where background features are exploited for the indication of occlusions. Feature points in these two sets are then dynamically maintained. For object appearance-based tracking, we propose a candidate tracker based on an enhanced anisotropic mean shift with a fully tunable (five degrees of freedom) bounding box that is partially guided by the above feature point tracker. Both candidate trackers contain a reinitialization process to reset the tracker in order to prevent accumulated tracking error propagation in frames. In addition, a novel online learning method is introduced to the enhanced mean shift-based candidate tracker. The reference object distribution is updated in each time interval if there is an indication of stable and reliable tracking without background interferences. By dynamically updating the reference object model, tracking is further improved by using a more accurate object appearance similarity measure. An optimal selection criterion is applied to the final tracker based on the results of these candidate trackers. Experiments have been conducted on several videos containing a range of complex scenarios. To evaluate the performance, the proposed scheme is further evaluated using three objective criteria, and compared with two existing trackers. All our results have shown that the proposed scheme is very robust and has yielded a marked improvement in terms of tracking drift, tightness, and accuracy of tracked bounding boxes, especially for complex video scenarios containing long-term partial occlusions or intersections, deformation, or background clutter with similar color distributions to the foreground object.

Kernel-Based On-Line Object Tracking Combining Both Local Description and Global Representation

Visual Object Tracking Based on Combination of Local Description and Global Representation

Beyond Local Search: Tracking Objects Everywhere with Instance-Specific Proposals

A Compensatory Algorithm for High-Speed Visual Object Tracking Based on Markov Chain

Feature-Based On-Line Object Tracking Combining Both Keypoints and Quasi-Keypoints Matching.

Generalized Kernel-Based Visual Tracking.

Object Tracking Algorithm based on Kalman Filter and Two Level Feature Matching

Kernelized Temporal Locality Learning for Real-Time Visual Tracking

On-line Object Tracking Method Based on Co-Training

Language-guided Dual-modal Local Correspondence for Single Object Tracking

Robust visual tracking based on local kernelized representation

Discriminative Object Tracking Via Sparse Representation and Online Dictionary Learning

Object Tracking Based on Locality-Constrained Linear Coding Joint Sparse Representation Appearance Model

Scale and rotation invariant feature-based object tracking via modified on-line boosting

Kernel Based Articulated Object Tracking with Scale Adaptation and Model Update

Object Tracking Via a Cooperative Appearance Model

Object Tracking with Joint Optimization of Representation and Classification

Joint Feature Correspondences and Appearance Similarity for Robust Visual Object Tracking

Long-Term Object Tracking Algorithm Based on Kernelized Correlation Filter

Kernel Based Visual Tracking with Scale Invariant Features

Local to Global Tracker: A Siamese Network for Long-term Tracking