Abstract:With the proliferation of camera sensors deployed world widely, video surveillance systems are gradually finding their way into our daily lives. A direct consequence of these technological advancements is the increased demand for intelligent video analysis and understanding techniques. This dissertation concentrates on the developments of efficient and effective multiple motion analysis techniques that allow automated tracking of multiple targets, which is arguably the most challenging problem and essential component of any intelligent video surveillance systems. Besides sharing the common challenges faced by visual tracking of single target, including large appearance variations, complex object motions, successful tracking of multiple targets' motions is also confronted by the tremendous difficulties from the theoretical and practical aspects of the problems, such as target occlusions, unknown number of targets, ambiguities of multiple target-tracker associations, high computational demanding, and difficulty of training a target detector. This dissertation presents several effective and computationally efficient techniques to addressing these challenges: a dynamic Bayesian network formulation for the multiple target tracking with explicit occlusion reasoning; a decentralized framework to multiple target tracking based on Markov network that handles the variable number of targets and copes with the tracker coalescence problem with close to linear complexity; a novel two-layer statistical field model to characterize the large shape variability and partial occlusions for nonrigid target detections, especially pedestrian detections; a component-based appearance tracker based on support vector machines to accommodate the large object appearance variations with the extra appealing capacity of automatically selecting trustworthy components while down-weighting the unreliable occluded components; a novel differential tracking approach based on a spatial-appearance model (SAM) formulation to combine the local appearances variations and global spatial structures enabling the continuous tracking of non-rigid objects that exhibit dramatic appearance deformations, large object scale changes and partial occlusions. Extensive experiments and very encouraging results on both the synthetic and real-world data verified the effectiveness and efficiency of the proposed methods.

Multiple Motion Analysis for Intelligent Video Surveillance

Detecting and Tracking Dynamic Objects in Complex Environments

Motion Targets Tracking Algorithm Based on Video Surveillance

Multi-person Multi-Camera Tracking for Live Stream Videos Based on Improved Motion Model and Matching Cascade

Effective multiple pedestrian tracking system in video surveillance with monocular stationary camera

A Top-View Multiple People Tracking System Based on Newest YOLOv5 and DeepSort Using Depth Data

Motion propagation detection association for multi-target tracking in wide area aerial surveillance

Tracking as A Whole: Multi-Target Tracking by Modeling Group Behavior with Sequential Detection

Real-time Multiple-Object Tracking and Anomaly Detection

Robust Video-Based Surveillance by Integrating Target Detection with Tracking

Multi-object trajectory tracking

MM-Tracker: Visual Tracking with A Multi-Task Model Integrating Detection and Differentiating Feature Extraction

Multi-object Tracking Via MHT with Multiple Information Fusion in Surveillance Video

Detection and Association Based Multi-Target Tracking in Surveillance Video

Improving Target Detection by Coupling It with Tracking

Bayesian video object tracking

Deep Learning and Hybrid Approaches for Dynamic Scene Analysis, Object Detection and Motion Tracking

Multi-object Tracking Within Air-Traffic-Control Surveillance Videos

Moving Targets Detection and Recognition Across Multiple Widely Separated Cameras

Multiple Object Tracking with Motion and Appearance Cues

Real-time moving target tracking based on dynamically switching models