Abstract:This is a study of tracking moving objects robustly and efficiently from a video stream. Video object tracking aids higher level image analysis by providing richer image information more efficiently. It can find many applications in smart video surveillance, video conferencing, human computer interface, traffic measurement, image stabilization, video compression, etc. However, it is still an open problem due to the difficulties from over/under segmentations, the different views of a moving object, the morphology of nonrigid objects, the occlusions of multiple moving objects, lighting changes, shadows, reflections, etc. These difficulties often result in frequent object loss, high false alarm ratio, and other problems. In this thesis we describe a Bayesian framework, combining with a novel model and an efficient particle filtering implementation, to combat those difficulties. The Bayesian approach is optimal in that it gives the minimum square error (MSE) estimation of the object's states being tracked. Because the key issue of this approach is modelling, a unique model was proposed and studied in this research. It consists of a compact representation of a moving object, a unique state vector formed from robust shape and colour features in addition to the often-used kinetic features, observations from motion detection, and their relationships described by the state dynamic and observation equations. This model has the advantages of being able to track non-rigid or shape-changing objects and being robust with lighting variations. In order to track multiple objects simultaneously, we studied the typical multiple hypothesis tracking algorithms and proposed a variation of the joint probability data association (JPDA) algorithm to solve the data association problem in video object tracking. For fully automatic tracking, a new technique based on sequential likelihood test is combined into the system for the object initialisation and deletion. This technique can greatly reduce the false-alarm ratio and track-loss frequency. The robustness and efficacy of the system are demonstrated by tracking various objects in a variety of applications, such as video based parking-plot surveillance, and video tracking from Unmanned Aerial Vehicles (UAVs).

Joint Bayes Filter: A Hybrid Tracker For Non-Rigid Hand Motion Recognition

A hybrid HMM/particle filter framework for non-rigid hand motion recognition

Probabilistic tracking and recognition of nonrigid hand motion

Human Tracking Using Improved Sample-Based Joint Probabilistic Data Association Filter.

2D Motion Detection Bounded Hand 3D Trajectory Tracking and Gesture Recognition under Complex Background

2d Articulated Tracking With Dynamic Bayesian Networks

New Color-Based Tracking Algorithm for Joints of the Upper Extremities

Robust Visual Tracking Based on Joint Multi-Feature Histogram by Integrating Particle Filter and Mean Shift

Robust Head Tracking Based on Multiple Cues Fusion in the Kernel-Bayesian Framework

A Robust Joint Space Tracking Method Based on Particle Filter

Robust Head Tracking Based on a Multi-State Particle Filter

Real Time Hand Tracking By Combining Particle Filtering And Mean Shift

Effective Inertial Hand Gesture Recognition Using Particle Filtering Based Trajectory Matching

Vision-Based Hand Detection and Tracking Using Fusion of Kernelized Correlation Filter and Single-Shot Detection

Adaptive Particle Filters for Visual Object Tracking Using Joint PCA Appearance Model and Consensus Point Correspondences

Bayesian Variational Human Tracking Based on Informative Body Parts

Bayesian video object tracking

Real-time Hand Tracking Using a Mean Shift Embedded Particle Filter

3D Hand Motion Tracking Using Improved Hidden Markov Model of Behavior

Learning-based Tracking of Complex Non-Rigid Motion

Hand Posture Recognition in Video Using Multiple Cues