Abstract:This is a study of tracking moving objects robustly and efficiently from a video stream. Video object tracking aids higher level image analysis by providing richer image information more efficiently. It can find many applications in smart video surveillance, video conferencing, human computer interface, traffic measurement, image stabilization, video compression, etc. However, it is still an open problem due to the difficulties from over/under segmentations, the different views of a moving object, the morphology of nonrigid objects, the occlusions of multiple moving objects, lighting changes, shadows, reflections, etc. These difficulties often result in frequent object loss, high false alarm ratio, and other problems. In this thesis we describe a Bayesian framework, combining with a novel model and an efficient particle filtering implementation, to combat those difficulties. The Bayesian approach is optimal in that it gives the minimum square error (MSE) estimation of the object's states being tracked. Because the key issue of this approach is modelling, a unique model was proposed and studied in this research. It consists of a compact representation of a moving object, a unique state vector formed from robust shape and colour features in addition to the often-used kinetic features, observations from motion detection, and their relationships described by the state dynamic and observation equations. This model has the advantages of being able to track non-rigid or shape-changing objects and being robust with lighting variations. In order to track multiple objects simultaneously, we studied the typical multiple hypothesis tracking algorithms and proposed a variation of the joint probability data association (JPDA) algorithm to solve the data association problem in video object tracking. For fully automatic tracking, a new technique based on sequential likelihood test is combined into the system for the object initialisation and deletion. This technique can greatly reduce the false-alarm ratio and track-loss frequency. The robustness and efficacy of the system are demonstrated by tracking various objects in a variety of applications, such as video based parking-plot surveillance, and video tracking from Unmanned Aerial Vehicles (UAVs).

Augmented tracking with incomplete observation and probabilistic reasoning

Partial Observation vs. Blind Tracking through Occlusion

Multi-object Tracking with Explicit Reasoning about Occlusion

Figure-Aware Tracking under Occlusion from Monocular Videos

Bayesian video object tracking

Embedding Ensemble Tracking in a Stochastic Framework for Robust Object Tracking

Multi-object tracking based on behaviour and partial observation

A Bayesian Detect to Track System for Robust Visual Object Tracking and Semi-Supervised Model Learning

Novel observation model for probabilistic object tracking

A Bayesian Filter for Multi-view 3D Multi-object Tracking with Occlusion Handling

A Distributed Multi-View Object Tracking Algorithm Under the Bayesian Framework

Tracking Occluded Objects And Recovering Incomplete Trajectories By Reasoning About Containment Relations And Human Actions

Visual tracking of partially observable targets with suboptimal filtering

Behaviour Reasoning And Tracking For Mobile Objects Based On Projection And Occlusion Ratios

Online Visual Multi-Object Tracking via Labeled Random Finite Set Filtering

Robust object tracking algorithm in natural environments

Combining Sparse Appearance and Bayesian Inference Models for Object Tracking

Object Tracking Algorithm Based on Improved Context Model in Combination with Detection Mechanism for Suspected Objects

Multi-object Tracking Through Occlusions by Local Tracklets Filtering and Global Tracklets Association with Detection Responses

Robust Visual Tracking Based on OLDM and Bayesian Estimation

Object detection and tracking in an open and dynamic world