Abstract:Visual object tracking acts as a pivotal component in various emerging video applications. Despite the numerous developments in visual tracking, existing deep trackers are still likely to fail when tracking against objects with dramatic variation. These deep trackers usually do not perform online update or update single sub-branch of the tracking model, for which they cannot adapt to the appearance variation of objects. Efficient updating methods are therefore crucial for tracking while previous meta-updater optimizes trackers directly over parameter space, which is prone to over-fit even collapse on longer sequences. To address these issues, we propose a context-aware tracking model to optimize the tracker over the representation space, which jointly meta-update both branches by exploiting information along the whole sequence, such that it can avoid the over-fitting problem. First, we note that the embedded features of the localization branch and the box-estimation branch, focusing on the local and global information of the target, are effective complements to each other. Based on this insight, we devise a context-aggregation module to fuse information in historical frames, followed by a context-aware module to learn affinity vectors for both branches of the tracker. Besides, we develop a dedicated meta-learning scheme, on account of fast and stable updating with limited training samples. The proposed tracking method achieves an EAO score of 0.514 on VOT2018 with the speed of 40FPS, demonstrating its capability of improving the accuracy and robustness of the underlying tracker with little speed drop.

Online Object Tracking Based on BLSTM-RNN with Contextual-Sequential Labeling

Exploit Spatiotemporal Contextual Information for 3D Single Object Tracking Via Memory Networks

RASTMTrack: Robust and Adaptive Space-Time Memory Networks for Visual Tracking

Learning Structure Models with Context Information for Visual Tracking.

Robust Visual Tracking With Context-Based Active Occlusion Recognition

Online Multiple Object Tracking Via Exchanging Object Context.

Robust Visual Tracking Based on OLDM and Bayesian Estimation

Object Tracking with Spatial Context Model

Robust Online Tracking Via Contrastive Spatio-Temporal Aware Network.

Online Multiple Object Tracking with Recurrent Neural Networks and Appearance Model

An Online Approach: Learning-Semantic-Scene-By-Tracking And Tracking-By-Learning-Semantic-Scene

Target-Aware Tracking with Long-term Context Attention

Context-aware Visual Tracking with Joint Meta-updating

Learning Multiple Instance Deep Quality Representation for Robust Object Tracking.

Online Structure Learning For Robust Object Tracking

Real-time Visual Object Tracking with Natural Language Description

Object Tracking via Spatial-Temporal Memory Network

Describe and Attend to Track: Learning Natural Language guided Structural Representation and Visual Attention for Object Tracking

Robust Visual Tracking Via Multi-Scale Spatio-Temporal Context Learning

Robust visual tracking based on online learning sparse representation

Visual Tracking Jointly with Online and Offline Learning