Abstract:Face tracking has many visual applications such as human-computer interfaces, video communications and surveillance. Color-based particle trackers have been proved robust and versatile for a modest computational cost. In this paper, a probabilistic method for integrating multi-camera information is introduced to track human face 3D-pose variations. The proposed method fuses information coming from several calibrated cameras via one color-based particle filter. The algorithm relies on the following novelties. First, the human head other than face is defined as the target of our algorithm. To distinguish the face region and hair region, a dual-color-ball is utilized to model the human head in 3D space. Second, to enhance the robustness to illumination variety, the Fisher criterion is applied to measure the separability of the face region and the hair region on the color histogram. Consequently, the color distribution template can be adapted at the proper time. Finally, the algorithm is performed based on the distributed framework, therefore the computation is implemented equally by all client processors. To demonstrate the performance of the proposed algorithm, several scenarios of visual tracking are tested in an office environment with three to four calibrated cameras. Experiments show that accurate tracking results are achieved, even in some difficult scenarios, such as the complete occlusion and the temptation of anything with skin color. Furthermore, the additional information of our track results, including the head posture and the face orientation schemes, can be used for further work such as face recognition and eye gaze estimation, which is also explained by elaborated designed experiments.

Fast Facial Feature Tracking with Multi-Cue Particle Filter

The improved particle filter for object tracking

Visual Contour Tracking Based on Inner-contour Particle Filter

Visual Contour Tracking Based on Inner-Contour Model Particle Filter under Complex Background

Efficient Particle Filter and Its Application in Contour Tracking

A Two-Step Approach To Multiple Facial Feature Tracking: Temporal Particle Filter And Spatial Belief Propagation

Dynamic Multi-Cue Tracking Using Particle Filter

Robust Head Tracking with Particles Based on Multiple Cues Fusion

Object contour tracking using multi-feature fusion based particle filter

Spatio-temporal Graphical-Model-based Multiple Facial Feature Tracking

Robust Head Tracking Based on a Multi-State Particle Filter

Multi-view and Multi-scale Face Tracking Based on Particle-filter

PARTICLE FILTER BASED MULTI-CAMERA INTEGRATION FOR FACE 3D-POSE TRACKING

Robust Visual Tracking Base on Adaptively Multi-Feature Fusion and Particle Filter

Particle Filter Based Visual Tracking with Multi-Cue Adaptive Fusion

Robust Object Tracking With Multi-Feature Selection and Particle Filter

Robust Visual Tracking Based on Joint Multi-Feature Histogram by Integrating Particle Filter and Mean Shift

Face Tracking Using Particle Filtering Based on Skin Color and Gabor Texture

Visual tracking using particle filters based on data fusion

Appearance Model-Based Particle Filter for Robust Tracking

Face Tracking with an Adaptive Adaboost-based Particle Filter