Abstract:In the modes of both object motion and camera motion, an enhanced Camshift algorithm, which is based on suppressing similar color features of background and on joint color probability density distribution image, is proposed to real-time track head in dynamic complex environment. The system consists of face detection module, head tracking module and camera control module. When tracking fails, a self-recovery mechanism is introduced. At first the Adaboost face detector based on Haar-like features is implemented to find frontal faces, the false positive is filtered according to the skin color criterion, and the true face is used to initialize the tracking module. In hue saturation value (HSV) colorspace, the hue-saturation (H-S) histogram of face skin and the saturation-value (S-V) histogram of hair are built to produce the joint color probability density distribution image, and this is intended to realize the head tracking with arbitrary pose. During tracking, region of interest (ROI) is introduced, and the color probability density distribution of a specified background area outside the ROI is learned, similar color features in the head are suppressed according to the learning result. The background suppression step is intended to resolve the problem that the tracker maybe fails when the head is distracted by backgrounds having similar colors with the head. A closed loop control model based on speed regulation is applied to drive an active camera to center the head. Once tracking drift or failure is detected, the system stops tracking and returns to the face detection module. Our experimental results show that the presented system is well suitable for tracking head with arbitrary pose in dynamic complex environments, also the active camera can track moving head smoothly and stably. The system is computationally efficient and can run in real-time completely.

Three-dimensional head pose tracking using registration and multi-scale appearance model

3D head tracking using SIFT-based registration and scale invariant view-based appearance model

Large head movement tracking using sift-based registration.

Real-time Follow-Up Head Tracking in Dynamic Complex Environments

Geometric and appearance model based approach for head pose recovery in monocular image sequence

3D Model Based Head Pose Tracking by Using Weighted Depth and Brightness Constraints

Face Pose Tracking with 3D Model and Weighted Depth and Brightness Constraints

Robust 3D head tracking by online feature registration

3 D face pose tracking based on feature matching

Robust monocular 3D object pose tracking for large visual range variation in robotic manipulation via scale-adaptive region-based method

Robust Head Tracking Based on Multiple Cues Fusion in the Kernel-Bayesian Framework

A New Head Pose Tracking Method Based on Stereo Visual SLAM

Three-dimensional Object Tracking Based on Perspective Scale Invariant Feature Transform Correspondences

Multi-scale Patch-Based Sparse Appearance Model for Robust Object Tracking

Mean Shift Algorithm Based on Fusion Model for Head Tracking

Multi-scale Mean Shift Tracking

Model- and Exemplar-based Robust Head Pose Tracking under Occlusion and Varying Expression

Scale-Aware Tracking Method with Appearance Feature Filtering and Inter-Frame Continuity

Simultaneous Tracking of Rigid Head Motion and Non-rigid Facial Animation by Analyzing Local Features Statistically

Face Feature Tracking and the Head Pose Estimating

Markerless Motion Capture Using Appearance and Inertial Data