Abstract:Recently, deep learning achieves competitive accuracy and robustness and dramatically improves the performance of target scale estimation through pre-trained special network branches. Yet, a fast and robust scale estimation method is still a challenging problem for visual object tracking. Early correlation filter tracking algorithm uses a multiscale search method to estimate the scale with the constant number of scale factors and invariant aspect ratio, which is redundant for the video frames with little or no scale change. Also, an independent network branch for target scale state is proposed, but the training network needs an abundance of datasets, and the effect is not very stable for the unseen target object. Aiming at the problems of existing scale estimation solutions, several variable scale learning methods are proposed to explore the scale change of the target. Firstly, we proposed a variable scale factor learning method, which makes us rid of the commonly used multiscale search with the flaws of fixed scale factors. Secondly, we used a multiscale aspect ratio solution to make up for invariant aspect ratio. Thirdly, the first and second scale methods were combined to propose a variable scale aspect ratio estimation method. Finally, the proposed scale estimation methods were embedded into the state-of-the-art ECO (Efficient Convolution Operators) and ATOM (Accurate Tracking by Overlap Maximization) trackers to replace the original scale methods for verifying the effectiveness of our proposed method. Extensive experiments on OTB100, UAV123, TC128 and LaSOT datasets demonstrate that the tracking performance can be improved effectively by using the proposed scale methods.

SITUP: Scale Invariant Tracking using Average Peak-to-Correlation Energy

Pixel Feature-Weighted Scale-Adaptive Object Tracking Algorithm

Collaborative Correlation Filters for Real-Time Tracking with Spatial Constraint.

High-speed Tracking with Multi-Templates Correlation Filters

A Scale Adaptive Kernel Correlation Filter Tracker With Feature Integration

Real-Time Scale Adaptive Visual Tracking with Context Information and Correlation Filters

Scale-Aware Tracking Method with Appearance Feature Filtering and Inter-Frame Continuity

Discriminative Scale Space Tracking

Scale-Adaptive Tracking Method by Combining Kernelized Correlation Filter with Geometric Estimation

Robust Estimation of Similarity Transformation for Visual Object Tracking

Real-Time Scalable Visual Tracking Via Quadrangle Kernelized Correlation Filters.

Beyond Local Search: Tracking Objects Everywhere with Instance-Specific Proposals

Learning Scale-Adaptive Tight Correlation Filter for Object Tracking

Scale-Adaptive Regression Position Prediction Tracking

Tracking Small and Fast Moving Objects: A Benchmark

Correlation filter tracking with adaptive proposal selection for accurate scale estimation

SCSTCF: Spatial-Channel Selection and Temporal Regularized Correlation Filters for visual tracking

Multi-Scale Correlation Filtering Tracker Based on Adaptive Feature Selection

Robust Visual Tracking Based on Scale Invariance and Deep Learning

Robust object tracking via multi-scale patch based sparse coding histogram

Variable Scale Learning for Visual Object Tracking