Abstract:A novel visual object tracking scheme is proposed by using joint point feature correspondences and object appearance similarity. For point feature-based tracking, we propose a candidate tracker that simultaneously exploits two separate sets of point feature correspondences in the foreground and in the surrounding background, where background features are exploited for the indication of occlusions. Feature points in these two sets are then dynamically maintained. For object appearance-based tracking, we propose a candidate tracker based on an enhanced anisotropic mean shift with a fully tunable (five degrees of freedom) bounding box that is partially guided by the above feature point tracker. Both candidate trackers contain a reinitialization process to reset the tracker in order to prevent accumulated tracking error propagation in frames. In addition, a novel online learning method is introduced to the enhanced mean shift-based candidate tracker. The reference object distribution is updated in each time interval if there is an indication of stable and reliable tracking without background interferences. By dynamically updating the reference object model, tracking is further improved by using a more accurate object appearance similarity measure. An optimal selection criterion is applied to the final tracker based on the results of these candidate trackers. Experiments have been conducted on several videos containing a range of complex scenarios. To evaluate the performance, the proposed scheme is further evaluated using three objective criteria, and compared with two existing trackers. All our results have shown that the proposed scheme is very robust and has yielded a marked improvement in terms of tracking drift, tightness, and accuracy of tracked bounding boxes, especially for complex video scenarios containing long-term partial occlusions or intersections, deformation, or background clutter with similar color distributions to the foreground object.

Equivalent Projection Based Distortion Invariant Visual Tracking for Omnidirectional Vision.

Visual Adaptive Tracking for Monocular Omnidirectional Camera

Geometric neighborhood model for visual tracking in central catadioptric omnidirectional vision

Multi-features Guided Robust Visual Tracking.

Robust Estimation of Similarity Transformation for Visual Object Tracking

Robust and Efficient Method for Matching Features in Omnidirectional Images

Robust visual tracking based on incremental discriminative projective non-negative matrix factorization

A Multiple Feature Fused Model for Visual Object Tracking Via Correlation Filters

Distortion-Tolerant Monocular Depth Estimation On Omnidirectional Images Using Dual-cubemap

360VOT: A New Benchmark Dataset for Omnidirectional Visual Object Tracking

Multi-tracker Fusion Via Adaptive Outlier Detection

OIDC-Net: Omnidirectional Image Distortion Correction via Coarse-to-Fine Region Attention

360VOTS: Visual Object Tracking and Segmentation in Omnidirectional Videos

A Visual Tracking Algorithm Via Confidence-Based Multi-Feature Correlation Filtering.

Multiple Feature Fused for Visual Tracking Via Correlation Filters

Object Tracking Via Deep Multi-View Compressive Model for Visible and Infrared Sequences.

A Multi-View Model for Visual Tracking Via Correlation Filters

Visual Tracking Using Region Covariance and Geometric Particle Filtering

Joint Feature Correspondences and Appearance Similarity for Robust Visual Object Tracking

Object Tracking Via a Cooperative Appearance Model

A Complementary Tracking Model with Multiple Features.