Abstract:In this paper we describe a real time video surveillance system which is capable of tracking multiple objects simultaneously and detecting violations. The number of objects is unknown and varies during tracking. Based on preliminary results of object detection in each image which may have missing and/or false detections, the multiple object tracking algorithm keeps a graph structure where it maintains multiple hypotheses about the number and the trajectories of the objects in the video. The image information drives the process of extending and pruning the graph, and determines the best hypothesis to explain the video. While the image-based object detection makes a local decision, the tracking process confirms and validates the detection through time, therefore, it can be regarded as temporal detection which makes a global decision across time. The multiple object tracking algorithm gives feedbacks which are predictions of object locations to the object detection module. Therefore, the algorithm integrates object detection and tracking tightly. The multiple object tracking algorithm is reliable to deal with occlusions, irregular object motions, changing appearances by postponing the decision of object trajectories until sufficient information is accumulated over time. The most possible hypothesis provides the multiple object tracking result which is used to accomplish anomaly detection. The trajectories generated by the tracking algorithm provide information of object identifications, motion histories, timing at sensitive areas and object interactions. Therefore, we are capable of detecting abnormal behaviors which are related to object counting, interaction, motion and timing. Since objects are tracked all the time, the anomaly detection module can also provide a scheme to report traffic information. The system has been running at a few access control areas for more than eighteen months. Experimental results on human tracking are presented and applications to anomaly detection are described.

Real-time object tracking from corners

Real-time object tracking

Real-time Follow-Up Head Tracking in Dynamic Complex Environments

Tracking Randomly Moving Objects on Edge Box Proposals

Real-time Object Tracking of a Robot Head Based on Multiple Visual Cues Integration.

Tracking Objects as Points

Tracking and Measuring a Moving Object with a Binocular Camera System

A Matching and Tracking Strategy for Independently Moving Objects

Real-Time Object Tracking Algorithm with Cameras Mounted on Moving Platforms.

Robust Object Tracking with Bidirectional Corner Matching and Trajectory Smoothness Algorithm.

Real-time Object Tracking Ofarobotheadbasedon Multiple Visual CuesIntegration

Adaptive Visual Object Tracking in Video

Object Tracking over Multiple Uncalibrated Cameras Using Visual, Spatial and Temporal Similarities.

Efficient Edge-Based Object Tracking.

Real-Time Multiple Objects Tracking with Occlusion Handling in Dynamic Scenes.

Real-Time Part-Based Visual Tracking Via Adaptive Correlation Filters

Real-time Head Tracking System with an Active Camera

Real-time Multiple-Object Tracking and Anomaly Detection

Long-term real time object tracking based on multi-scale local correlation filtering and global re-detection

Real Time Multiple Object Tracking Using Tracking Matrix