Abstract:The majority of existing tracking algorithms are based on the maximum a posteriori solution of a probabilistic framework using a Hidden Markov Model, where the distribution of the object state at the current time instance is estimated based on current and previous observations. However, this approach is prone to errors caused by distractions such as occlusions, background clutters and multi-object confusions. In this paper, we propose a multiple object tracking algorithm that seeks the optimal state sequence that maximizes the joint multi-object state-observation probability. We call this algorithm trajectory tracking since it estimates the state sequence or “trajectory” instead of the current state. The algorithm is capable of tracking unknown time-varying number of multiple objects. We also introduce a novel observation model which is composed of the original image, the foreground mask given by background subtraction and the object detection map generated by an object detector. The image provides the object appearance information. The foreground mask enables the likelihood computation to consider the multi-object configuration in its entirety. The detection map consists of pixel-wise object detection scores, which drives the tracking algorithm to perform joint inference on both the number of objects and their configurations efficiently. The proposed algorithm has been implemented and tested extensively in a complete CCTV video surveillance system to monitor entries and detect tailgating and piggy-backing violations at access points for over six months. The system achieved 98.3% precision in event classification. The violation detection rate is 90.4% and the detection precision is 85.2%. The results clearly demonstrate the advantages of the proposed detection based trajectory tracking framework.

Object Tracking Through Multiple Cues

Humans Tracking In The Complicated Background By Multi-Cue Integration

Multi-Cue Based Tracking

Robust Head Tracking Based on Multiple Cues Fusion in the Kernel-Bayesian Framework

Object tracking by combining multi-cues

Adaptive multi-cue tracking by online appearance learning

Object Tracking Based on Adaptive Multi-Cue Integration Mean Shift

Real-time Object Tracking of a Robot Head Based on Multiple Visual Cues Integration.

Multi-invariance appearance model for object tracking

Object Tracking with Adaptive Multicue Incremental Visual Tracker

Adaptive Multi-Cue Kernel Tracking

Robust Object Tracking Via Multi-Cue Fusion.

Robust Visual Tracking Based on Multi-Cue Integration

Real-time Object Tracking Ofarobotheadbasedon Multiple Visual CuesIntegration

LSTM Multiple Object Tracker Combining Multiple Cues.

Visual Tracking Strategy Based on Fuzzy Multi Visnal Cue Integration

Relative Discriminant Coefficient Based Multi-Cue Fusion for Robust Object Tracking

Detection driven adaptive multi-cue integration for multiple human tracking

Multiple Object Tracking with Motion and Appearance Cues

Active-matting-based Object Tracking with Color Cues

Multi-object trajectory tracking