Abstract:Visual tracking algorithms based on structured output support vector machine (SOSVM) have demonstrated excellent performance. However, sampling methods and optimization strategies of SOSVM undesirably increase the computational overloads, which hinder real-time application of these algorithms. Moreover, due to the lack of high-dimensional features and dense training samples, SOSVM-based algorithms are unstable to deal with various challenging scenarios, such as occlusions and scale variations. Recently, visual tracking algorithms based on discriminative correlation filters (DCF), especially the combination of DCF and features from deep convolutional neural networks (CNN), have been successfully applied to visual tracking, and attains surprisingly good performance on recent benchmarks. The success is mainly attributed to two aspects: the circular correlation properties of DCF and the powerful representation capabilities of CNN features. Nevertheless, compared with SOSVM, DCF-based algorithms are restricted to simple ridge regression which has a weaker discriminative ability. In this paper, a novel circular and structural operator tracker (CSOT) is proposed for high performance visual tracking, it not only possesses the powerful discriminative capability of SOSVM but also efficiently inherits the superior computational efficiency of DCF. Based on the proposed circular and structural operators, a set of primal confidence score maps can be obtained by circular correlating feature maps with their corresponding structural correlation filters. Furthermore, an implicit interpolation is applied to convert the multi-resolution feature maps to the continuous domain and make all primal confidence score maps have the same spatial resolution. Then, we exploit an efficient ensemble post-processor based on relative entropy, which can coalesce primal confidence score maps and create an optimal confidence score map for more accurate localization. The target is localized on the peak of the optimal confidence score map. Besides, we introduce a collaborative optimization strategy to update circular and structural operators by iteratively training structural correlation filters, which significantly reduces computational complexity and improves robustness. Experimental results demonstrate that our approach achieves state-of-the-art performance in mean AUC scores of 71.5% and 69.4% on the OTB2013 and OTB2015 benchmarks respectively, and obtains a third-best expected average overlap (EAO) score of 29.8% on the VOT2017 benchmark.

LCO: Lightweight Convolution Operators for Fast Tracking

High-speed Tracking with Multi-Templates Correlation Filters

Collaborative Convolution Operators for Real-Time Coarse-to-Fine Tracking

Learning Low-Rank and Sparse Discriminative Correlation Filters for Coarse-to-Fine Visual Object Tracking

Discriminative Correlation Filter for Long-Time Tracking

Learning Target-Aware Correlation Filters for Visual Tracking

Improved C-COT based on feature channels confidence for visual tracking

Object Tracking Based on Vector Convolutional Network and Discriminant Correlation Filters.

A Scale Adaptive Kernel Correlation Filter Tracker With Feature Integration

Learning Adaptive Spatial Regularization and Temporal-Aware Correlation Filters for Visual Object Tracking

Beyond Feature Integration: a Coarse-to-fine Framework for Cascade Correlation Tracking

Large Margin Structured Convolution Operator For Thermal Infrared Object Tracking

Lightweight Full-Convolutional Siamese Tracker

When Correlation Filters Meet Siamese Networks for Real-Time Complementary Tracking.

Learning Adaptive Discriminative Correlation Filters via Temporal Consistency Preserving Spatial Feature Selection for Robust Visual Tracking

Learning Adaptively Windowed Correlation Filters for Robust Tracking

Efficient Object Tracking based on Circular and Structural Multi-level Learners.

Multi-Channel Feature Dimension Adaption for Correlation Tracking

Correlation filter tracking algorithm based on spatial-temporal regularization and context awareness

SCSTCF: Spatial-Channel Selection and Temporal Regularized Correlation Filters for visual tracking

Multi-cue Correlation Filters for Robust Visual Tracking