Abstract:In recent years, tracking algorithms based on correlation filtering have been widely considered because of their high real-time performance. However, most of these algorithms do not consider the reliability of tracking results; thus, model drift is often a challenge in long-term target tracking. Moreover, the target is significantly occluded or disappears in long-term target tracking, hence the need for research to address such complexities. This paper proposes a long-term tracking framework comprising a tracking and re-detection module. The tracking module is based on the efficient convolution operator target-tracking algorithm (ECO) (Danelljan et al. in Proc IEEE Conf Comput Vis Pattern Recognit, 1). To redetect a lost target, a tracking uncertainty estimation method is developed that evaluates the tracking results of each image. Furthermore, an adaptive model-updating method is proposed, which can reduce the number of model updates and improve the robustness of the tracking algorithm. The model is inspired by long and short-term memory pool mechanisms of the brain, applying both mechanisms to the traditional tracking algorithm to improve long-term tracking. The memory model is effectively integrated into a brain-inspired visual long-term tracker through mutual learning and inspiration from computer and biological vision. In addition, the brain-inspired visual model can be made bio-cognitive on a small hardware platform with limited computing power. Central processing unit (CPU)-based experiments using two data sets, UAV20L (Mueller et al. in Eur Conf Comput Vision, 2) and UAV123 (Wu et al. in Proc IEEE Conf Comput Vis Pattern Recognit, 3), confirmed that the proposed method runs faster than 30fps. Furthermore, the long-term tracking test using the UAV20L data set showed that the proposed method performs better than any other method by 39%. Compared with conventional tracking methods, the proposed method has better performance in terms of coverage rate and positioning accuracy.

PLATE: A perception-latency aware estimator,

Perception-latency aware distributed target tracking

APPTracker Plus : Displacement Uncertainty for Occlusion Handling in Low-Frame-Rate Multiple Object Tracking

APPTracker: Improving Tracking Multiple Objects in Low-Frame-Rate Videos

Towards Streaming Perception

Beyond Local Search: Tracking Objects Everywhere with Instance-Specific Proposals

'Skimming-Perusal' Tracking: A Framework for Real-Time and Robust Long-term Tracking

Tracking Randomly Moving Objects on Edge Box Proposals

PVT++: A Simple End-to-End Latency-Aware Visual Tracking Framework

A long-memory pedestrian target tracking algorithm incorporating spatiotemporal trajectory feature enhancement model

Predictive Visual Tracking: A New Benchmark and Baseline Approach

Target-Aware Tracking with Long-term Context Attention

A Perceptually Adaptive Long-Term Tracking Method for the Complete Occlusion and Disappearance of a Target

Pseudo Loss Active Learning for Deep Visual Tracking

StreamYOLO: Real-time Object Detection for Streaming Perception

Adaptive Ensemble Perception Tracking

Context-Aware Streaming Perception in Dynamic Environments

Unified Perception: Efficient Depth-Aware Video Panoptic Segmentation with Minimal Annotation Costs

APPTracker+: Displacement Uncertainty for Occlusion Handling in Low-Frame-Rate Multiple Object Tracking

A Saliency Prior Context Model for Real-Time Object Tracking

Efficient Online Multi-Person 2D Pose Tracking with Recurrent Spatio-Temporal Affinity Fields