Abstract:In the modes of both object motion and camera motion, an enhanced Camshift algorithm, which is based on suppressing similar color features of background and on joint color probability density distribution image, is proposed to real-time track head in dynamic complex environment. The system consists of face detection module, head tracking module and camera control module. When tracking fails, a self-recovery mechanism is introduced. At first the Adaboost face detector based on Haar-like features is implemented to find frontal faces, the false positive is filtered according to the skin color criterion, and the true face is used to initialize the tracking module. In hue saturation value (HSV) colorspace, the hue-saturation (H-S) histogram of face skin and the saturation-value (S-V) histogram of hair are built to produce the joint color probability density distribution image, and this is intended to realize the head tracking with arbitrary pose. During tracking, region of interest (ROI) is introduced, and the color probability density distribution of a specified background area outside the ROI is learned, similar color features in the head are suppressed according to the learning result. The background suppression step is intended to resolve the problem that the tracker maybe fails when the head is distracted by backgrounds having similar colors with the head. A closed loop control model based on speed regulation is applied to drive an active camera to center the head. Once tracking drift or failure is detected, the system stops tracking and returns to the face detection module. Our experimental results show that the presented system is well suitable for tracking head with arbitrary pose in dynamic complex environments, also the active camera can track moving head smoothly and stably. The system is computationally efficient and can run in real-time completely.

High-precision Detection of Facial Landmarks to Estimate Head Motions Based on Vision Models

Toward A Robust System To Monitor Head Motions During Pet Based On Facial Landmark Detection: A New Approach

Detection of Head Motions Using a Vision Model

Real-time Follow-Up Head Tracking in Dynamic Complex Environments

3D head tracking using SIFT-based registration and scale invariant view-based appearance model

A Motion Correction System for Brain Tomography Based on Biologically Motivated Models

Head-Pose Estimation Based on Lateral Canthus Localizations in 2-D Images

Multi-person Vision-Based Head Detector for Markerless Human Motion Capture

Fast Head Pose Estimation Via Rotation-Adaptive Facial Landmark Detection for Video Edge Computation.

Objective Micro-Facial Movement Detection Using FACS-Based Regions and Baseline Evaluation

Expression Robust 3D Facial Landmarking Via Progressive Coarse-to-Fine Tuning.

A Method of Head Pose Estimation Based on Active Shape Model and Stereo Vision

Facial Landmark Detection Based on High Precision Spatial Sampling Via Millimeter-wave Radar

Face Pose Estimation Based on 3D Models and Affine Correspondences

Facial Landmark-Guided Surface Matching for Image-to-patient Registration with an RGB-D Camera.

Navigation system based on machine vision of multiple reference markers

3D Facial Landmark Localization Based on Two-Step Keypoint Detection

Motion Resistant Facial Video based Heart Rate Estimation Method using Head-Mounted Camera

Approach of Scattered Data Processing for Optical Motion Capture

Estimating Head Motion from MR-Images

Facial Landmarks Detection under Occlusions Via Extended Restricted Boltzmann Machine