Abstract:Discriminative correlation filters (DCF)-based trackers have been increasingly applied to visual tracking due to their high precision while running at high frame rates. However, most recent DCF-based methods solely concentrate on learning the correlation filter with spatial information and thus do not have sufficient descriptive power to discriminate the target from the background in the complex circumstances, such as full occlusion (OCC) and rapid target variation. In this article, we introduce a novel tracking framework that exploits the relationship between the target and its spatiotemporal context to improve tracking accuracy and robustness. Especially, we present our spatiotemporal context model in a hierarchical way, where each layer of the context pyramid is a spatial correlation filter learned from different temporal instances. For gaining an accurate spatiotemporal model, we propose an optimization fusion approach that can adaptively and efficiently learn the effect of each hierarchical layer and exploit these multiple temporal levels of correlation filters for visual tracking. Moreover, an adaptive model update strategy for correlation filters is introduced into the framework to dynamically select proper hierarchical layers, which boosts the temporal diversity of the target appearance, while radically reduces the number of model parameters and guarantees the real-time performance of the tracking method. The experimental results show that, with conventional handcrafted features, our tracker achieves the best success rates among available state-of-the-art trackers with handcrafted features, and provides state-of-the-art performance comparable to those of deep-learning-based trackers on OTB-2013, OTB-2015, VOT-2016, and UAV-20L benchmarks but runs significantly faster than deep trackers.

Robust Visual Tracking with Dual Spatio-Temporal Context Trackers

Exploit Spatiotemporal Contextual Information for 3D Single Object Tracking Via Memory Networks

Robust and Fast Visual Tracking Via Spatial Kernel Phase Correlation Filter.

Adaptive Spatio-Temporal Context Learning for Visual Tracking

Robust Visual Tracking Via Multi-Scale Spatio-Temporal Context Learning

Robust Spatio-Temporal Context for Infrared Target Tracking

Oversaturated part-based visual tracking via spatio-temporal context learning.

Spatial-Temporal Context-Aware Tracking.

Long-term Tracking Based on Spatio-Temporal Context Model *

Robust Visual Tracking Via Context Objects Computing

Real-Time Scale Adaptive Visual Tracking with Context Information and Correlation Filters

Robust Visual Tracking Integrating Spatio-Temporal Model

Sparse Representation Combined with Context Information for Visual Tracking.

Hierarchical Spatiotemporal Context-Aware Correlation Filters for Visual Tracking

Robust Correlation Filter Tracking Via Context Fusion and Subspace Constraint.

Robust Visual Tracking Based on Spatial Context Pyramid

Spatial-sequential-spectral Context Awareness Tracking.

Efficient Scalable Spatiotemporal Visual Tracking Based on Recurrent Neural Networks.

An Efficient And Robust Visual Tracking Via Color-Based Context Prior Model

Spatial-Temporal Aware Long-Term Object Tracking

Robust Particle Tracking Via Spatio-Temporal Context Learning and Multi-Task Joint Local Sparse Representation