Abstract:A novel visual object tracking scheme is proposed by using joint point feature correspondences and object appearance similarity. For point feature-based tracking, we propose a candidate tracker that simultaneously exploits two separate sets of point feature correspondences in the foreground and in the surrounding background, where background features are exploited for the indication of occlusions. Feature points in these two sets are then dynamically maintained. For object appearance-based tracking, we propose a candidate tracker based on an enhanced anisotropic mean shift with a fully tunable (five degrees of freedom) bounding box that is partially guided by the above feature point tracker. Both candidate trackers contain a reinitialization process to reset the tracker in order to prevent accumulated tracking error propagation in frames. In addition, a novel online learning method is introduced to the enhanced mean shift-based candidate tracker. The reference object distribution is updated in each time interval if there is an indication of stable and reliable tracking without background interferences. By dynamically updating the reference object model, tracking is further improved by using a more accurate object appearance similarity measure. An optimal selection criterion is applied to the final tracker based on the results of these candidate trackers. Experiments have been conducted on several videos containing a range of complex scenarios. To evaluate the performance, the proposed scheme is further evaluated using three objective criteria, and compared with two existing trackers. All our results have shown that the proposed scheme is very robust and has yielded a marked improvement in terms of tracking drift, tightness, and accuracy of tracked bounding boxes, especially for complex video scenarios containing long-term partial occlusions or intersections, deformation, or background clutter with similar color distributions to the foreground object.

Object Tracking Using Bidirectional Spatio-temporal Continuity Tracklet Association

APPTracker Plus : Displacement Uncertainty for Occlusion Handling in Low-Frame-Rate Multiple Object Tracking

APPTracker: Improving Tracking Multiple Objects in Low-Frame-Rate Videos

Exploit Spatiotemporal Contextual Information for 3D Single Object Tracking Via Memory Networks

Multi-object Tracking by Expanding Long-Tracklets

Continuity-Discrimination Convolutional Neural Network for Visual Object Tracking

Dynamic Feature Cascade For Multiple Object Tracking With Trackability Analysis

Joint spatio-temporal modeling for visual tracking

Joint Feature Correspondences and Appearance Similarity for Robust Visual Object Tracking

Object Tracking Using Spatio-Temporal Future Prediction

Multi-object Tracking Through Occlusions by Local Tracklets Filtering and Global Tracklets Association with Detection Responses

Tracking Multiple Video Objects Based on Improved Joint Probabilistic Data Association

Multiple Object Tracking based on Occlusion-Aware Embedding Consistency Learning

Occlusion-Aware Visual Object Tracking Based on Multi-template Updating Siamese Network

Non-Rigid Object Tracking As Salient Region Segmentation And Association

ConsistencyTrack: A Robust Multi-Object Tracker with a Generation Strategy of Consistency Model

Tracklet Association by Online Target-Specific Metric Learning and Coherent Dynamics Estimation

Multi-object Tracking with Tracked Object Bounding Box Association

An Occlusion Tolerent Method For Multi-Object Tracking

On Multiple Objects Tracking Based on Linear Fitting

Modeling of Multiple Spatial-Temporal Relations for Robust Visual Object Tracking