Bayesian video object tracking
Jun Zhang,Dehong Ma
2006-01-01
Abstract:This is a study of tracking moving objects robustly and efficiently from a video stream. Video object tracking aids higher level image analysis by providing richer image information more efficiently. It can find many applications in smart video surveillance, video conferencing, human computer interface, traffic measurement, image stabilization, video compression, etc. However, it is still an open problem due to the difficulties from over/under segmentations, the different views of a moving object, the morphology of nonrigid objects, the occlusions of multiple moving objects, lighting changes, shadows, reflections, etc. These difficulties often result in frequent object loss, high false alarm ratio, and other problems. In this thesis we describe a Bayesian framework, combining with a novel model and an efficient particle filtering implementation, to combat those difficulties. The Bayesian approach is optimal in that it gives the minimum square error (MSE) estimation of the object's states being tracked. Because the key issue of this approach is modelling, a unique model was proposed and studied in this research. It consists of a compact representation of a moving object, a unique state vector formed from robust shape and colour features in addition to the often-used kinetic features, observations from motion detection, and their relationships described by the state dynamic and observation equations. This model has the advantages of being able to track non-rigid or shape-changing objects and being robust with lighting variations. In order to track multiple objects simultaneously, we studied the typical multiple hypothesis tracking algorithms and proposed a variation of the joint probability data association (JPDA) algorithm to solve the data association problem in video object tracking. For fully automatic tracking, a new technique based on sequential likelihood test is combined into the system for the object initialisation and deletion. This technique can greatly reduce the false-alarm ratio and track-loss frequency. The robustness and efficacy of the system are demonstrated by tracking various objects in a variety of applications, such as video based parking-plot surveillance, and video tracking from Unmanned Aerial Vehicles (UAVs).