Abstract:In the modes of both object motion and camera motion, an enhanced Camshift algorithm, which is based on suppressing similar color features of background and on joint color probability density distribution image, is proposed to real-time track head in dynamic complex environment. The system consists of face detection module, head tracking module and camera control module. When tracking fails, a self-recovery mechanism is introduced. At first the Adaboost face detector based on Haar-like features is implemented to find frontal faces, the false positive is filtered according to the skin color criterion, and the true face is used to initialize the tracking module. In hue saturation value (HSV) colorspace, the hue-saturation (H-S) histogram of face skin and the saturation-value (S-V) histogram of hair are built to produce the joint color probability density distribution image, and this is intended to realize the head tracking with arbitrary pose. During tracking, region of interest (ROI) is introduced, and the color probability density distribution of a specified background area outside the ROI is learned, similar color features in the head are suppressed according to the learning result. The background suppression step is intended to resolve the problem that the tracker maybe fails when the head is distracted by backgrounds having similar colors with the head. A closed loop control model based on speed regulation is applied to drive an active camera to center the head. Once tracking drift or failure is detected, the system stops tracking and returns to the face detection module. Our experimental results show that the presented system is well suitable for tracking head with arbitrary pose in dynamic complex environments, also the active camera can track moving head smoothly and stably. The system is computationally efficient and can run in real-time completely.

A real-time head nod and shake detector using HMMs.

Dynamic hand gesture recognition using hidden Markov models

A real-time hand gesture recognition method

Real-time Follow-Up Head Tracking in Dynamic Complex Environments

Real-Time facial expression recognition system based on HMM and feature point localization

Recognition of Multi-Pose Head Gestures in Human Conversations

Video Based Head Detection and Tracking Surveillance System

Machine Learning for Single and Complex 3D Head Gestures: Classification in Human-Computer Interaction

A Real Time Vision-Based Hand Gestures Recognition System

SVM Point-Based Real-Time Emotion Detection

Gesture recognition using combination of acceleration sensor and images for casual communication between robots and humans

Non-intrusive gesture recognition system combining with face detection based on Hidden Markov Model

A Hmm Based Operational Gesture Recognition Method

Remote Heart Rate Measurement from Face Videos under Realistic Situations

Head Gesture Recognition Combining Activity Detection and Dynamic Time Warping

A real-time attitude recognition by eye-tracking

Eye-gaze Estimation with HEOG and Neck EMG Using Deep Neural Networks

Hidden Markov models based dynamic hand gesture recognition with incremental learning method

HMM-based operational gesture recognition method

Early Facial Expression Recognition Using Hidden Markov Models

Real-time Lip Synchronization Based on Hidden Markov Models