Abstract:These trackers based on the space-time memory network locate the target object in the search image employing contextual information from multiple memory frames and their corresponding foreground-background features. It is conceivable that these trackers are susceptible to the memory frame quality as well as the accuracy of the corresponding foreground labels. In the previous work (STMTrack), a fixed and experienced extraction strategy for memory frames was adopted, which hinders the improvement of performance and generalization. To address these limitations, we propose a dynamic and adaptive extraction strategy for memory frames to ensure that the most representative historical frames are selected into the set of memory frames to improve the accuracy of localization and reduce failures due to error accumulation. Specifically, we propose an extraction network to evaluate historical frames, where historical frames with the highest score are labeled as the memory frame and conversely dropped. Qualitative and quantitative analyses were implemented on multiple datasets (LaSOT and GOT-10K), and our method achieves significant performance gains (LaSOT: 60.6→61.4, GOT-10K: 64.2→65.2) over STMTrack especially for challenging scenarios (e.g., occlusion, vanishing, and reappearance, etc.). while bringing only a negligible inference speed degradation (Fps: 37 → 34), otherwise, the proposed method obtains competitive results compared to other state-of-the-art (SOTA) methods (CNN-based).

Temporal Coherent and Graph Optimized Manifold Ranking for Visual Tracking

Robust visual tracking via weighted incremental subspace learning

Robust Visual Tracking Via Multi-Graph Ranking

Exploit Spatiotemporal Contextual Information for 3D Single Object Tracking Via Memory Networks

RASTMTrack: Robust and Adaptive Space-Time Memory Networks for Visual Tracking

STGL: Spatial-Temporal Graph Representation and Learning for Visual Tracking

Part-Based Multi-Graph Ranking for Visual Tracking

Temporal Restricted Visual Tracking Via Reverse-Low-Rank Sparse Learning.

Reliable Patch Trackers: Robust Visual Tracking by Exploiting Reliable Patches

Tracking in Multimedia Data Via Robust Reweighted Local Multi-Task Sparse Representation for Transportation Surveillance

RGBT tracking based on cooperative low-rank graph model

Robust Tracking via Locally Structured Representation

Robust Tracking with Discriminative Ranking Middle-Level Patches

TLPG-Tracker: Joint Learning of Target Localization and Proposal Generation for Visual Tracking.

Real Time Visual Tracking using Spatial-Aware Temporal Aggregation Network

Object Tracking Using Learned Feature Manifolds

Joint spatio-temporal modeling for visual tracking

Visual Tracking with Structured Patch-Based Model

An Improved C-COT Based Visual Tracking Scheme to Weighted Fusion of Diverse Features

Towards Real-World Visual Tracking with Temporal Contexts