Abstract:In this paper we describe a real time video surveillance system which is capable of tracking multiple objects simultaneously and detecting violations. The number of objects is unknown and varies during tracking. Based on preliminary results of object detection in each image which may have missing and/or false detections, the multiple object tracking algorithm keeps a graph structure where it maintains multiple hypotheses about the number and the trajectories of the objects in the video. The image information drives the process of extending and pruning the graph, and determines the best hypothesis to explain the video. While the image-based object detection makes a local decision, the tracking process confirms and validates the detection through time, therefore, it can be regarded as temporal detection which makes a global decision across time. The multiple object tracking algorithm gives feedbacks which are predictions of object locations to the object detection module. Therefore, the algorithm integrates object detection and tracking tightly. The multiple object tracking algorithm is reliable to deal with occlusions, irregular object motions, changing appearances by postponing the decision of object trajectories until sufficient information is accumulated over time. The most possible hypothesis provides the multiple object tracking result which is used to accomplish anomaly detection. The trajectories generated by the tracking algorithm provide information of object identifications, motion histories, timing at sensitive areas and object interactions. Therefore, we are capable of detecting abnormal behaviors which are related to object counting, interaction, motion and timing. Since objects are tracked all the time, the anomaly detection module can also provide a scheme to report traffic information. The system has been running at a few access control areas for more than eighteen months. Experimental results on human tracking are presented and applications to anomaly detection are described.

Multiple Moving Objects Tracking under Complex Scenes

Detecting and Tracking Dynamic Objects in Complex Environments

A Novel Method For Real-Time Object Detection And Multiple Persons Tracking

Real-time Follow-Up Head Tracking in Dynamic Complex Environments

Robust Detection and Tracking Algorithm of Multiple Objects in Complex Scenes

Real-Time Multiple Objects Tracking with Occlusion Handling in Dynamic Scenes.

Effective Method for Tracking Multiple Objects in Real-Time Visual Surveillance Systems

Research and Implementation of Detecting and Tracking Multiple Moving Objects Method

A Multiple Objects Tracking Method Based on a Combination of Camshift and Object Trajectory Tracking.

A Multiple Object Tracking Method Using Kalman Filter

Real Time Multiple Object Tracking Using Tracking Matrix

Tracking multiple moving objects in complex scenes based on attributed relational graph optimizing match

Moving Objects Detecting and Tracking Based on Kalman Filter

Real-time Multiple-Object Tracking and Anomaly Detection

Tracking multiple objects in occlusions

Multi-strategy object tracking in complex situation for video surveillance

Adaptive method for tracking mobile object in occlusion

Multiple-object tracking in cluttered and crowded public spaces

A Multi-Object Tracking Algorithm Based on Multi-Camera

Human Tracking in Multi-Scene Video Surveillance

Multi-object tracking based on behaviour and partial observation