Facetracker: A Human Face Tracking And Facial Organ Localizing System

J Miao,Hm Zhang,W Gao,G Deng,H Liu,Xl Chen

DOI: https://doi.org/10.1109/ICCV.2001.937705

2001-01-01

Abstract:A tracking system to track faces and localize facial organs is presented. The system is more practical compared to some detecting schemes such as deformable template technique.

What problem does this paper attempt to address?

Real-time Detection and Tracking Algorithm Based on the Color and Character of Human Face

XIANG Gui-shan,WANG Xuan-yin,LIANG Dong-tai

DOI: https://doi.org/10.3969/j.issn.1003-501x.2007.04.010

2007-01-01

Abstract:For fast detecting and tracking human face in real-time video, a method based on the color and character of face was proposed. Moving human-body objects were extracted from video according to temporal differencing and shape information firstly, and then the skin area was segmented based on its Gaussian model established due to the clustering character of skin color in YCbCr color space. After noise was suppressed, the non-face skin area was eliminated according to the geometric characters of face and the color characters of organs in face, and then the face was located in image. According to the face location, the head and shoulder part were centered in video by driving camera using control strategy, so movement tracking was realized. In order to enhance the adaptability for light changes, proper updating strategy for the Gaussion model parameters was proposed. Experiments show that the proposed method performs well in face detection and tracking in both simple background and complex background.
Robust Human Tracking Via Key Face Information.

Weisheng Li,Xinyi Li,Lifang Zhou

DOI: https://doi.org/10.3837/tiis.2016.10.026

2016-01-01

KSII Transactions on Internet and Information Systems

Abstract:Tracking human body is an important problem in computer vision field. Tracking failures caused by occlusion can lead to wrong rectification of the target position. In this paper, a robust human tracking algorithm is proposed to address the problem of occlusion, rotation and improve the tracking accuracy. It is based on Tracking-Learning-Detection framework. The key auxiliary information is used in the framework which motivated by the fact that a tracking target is usually embedded in the context that provides useful information. First, face localization method is utilized to find key face location information. Second, the relative position relationship is established between the auxiliary information and the target location. With the relevant model, the key face information will get the current target position when a target has disappeared. Thus, the target can be stably tracked even when it is partially or fully occluded. Experiments are conducted in various challenging videos. In conjunction with online update, the results demonstrate that the proposed method outperforms the traditional TLD algorithm, and it has a relatively better tracking performance than other state-of-the-art methods.
A Single-Camera Gaze Tracking System under Natural Light

Feng Xiao,Dandan Zheng,Kejie Huang,Yue Qiu,Haibin Shen

DOI: https://doi.org/10.16910/jemr.11.4.5

IF: 1.3489

2018-01-01

Journal of Eye Movement Research

Abstract:Gaze tracking is a human-computer interaction technology, and it has been widely studied in the academic and industrial fields. However, constrained by the performance of the specific sensors and algorithms, it has not been popularized for everyone. This paper proposes a single-camera gaze tracking system under natural light to enable its versatility. The iris center and anchor point are the most crucial factors for the accuracy of the system. The accurate iris center is detected by the simple active contour snakuscule, which is initialized by the prior knowledge of eye anatomical dimensions. After that, a novel anchor point is computed by the stable facial landmarks. Next, second-order mapping functions use the eye vectors and the head pose to estimate the points of regard. Finally, the gaze errors are improved by implementing a weight coefficient on the points of regard of the left and right eyes. The feature position of the iris center achieves an accuracy of 98.87% on the GI4E database when the normalized error is lower than 0.05. The accuracy of the gaze tracking method is superior to the-state-of-the-art appearance-based and feature-based methods on the EYEDIAP database.
A Simple 3d Face Tracking Method Based On Depth Information

Gangqiang Zhao,Linghong Chen,

DOI: https://doi.org/10.1109/icmlc.2005.1527828

2005-01-01

Abstract:3D face tracking is useful in many applications such as face recognition, analysis of facial expressions and entertainment. Most existing 3D face tracking methods employ multiple cameras and all cameras need to be calibrated first before tracking. The complexity of these methods restricts the applications of them. This paper presents a new simple face tracking method which is based on a stereo vision camera system. All cameras in this stereo vision camera system are pre-calibrated and the system can provide accurate depth information of the scene. The proposed tracking method adopts KLT and template matching to track 2D facial features. Then the stereo vision camera system is used to obtain corresponding depth information of these features. In order to achieve robust tracking, some spatial constraints of these features are employed. Experiment results indicate that the proposed method can achieve robust and accurate 3D face tracking.
Real-time Follow-Up Head Tracking in Dynamic Complex Environments

Gui-shan Xiang,Xuan-yin Wang

DOI: https://doi.org/10.1007/s12204-009-0593-2

2009-01-01

Abstract:In the modes of both object motion and camera motion, an enhanced Camshift algorithm, which is based on suppressing similar color features of background and on joint color probability density distribution image, is proposed to real-time track head in dynamic complex environment. The system consists of face detection module, head tracking module and camera control module. When tracking fails, a self-recovery mechanism is introduced. At first the Adaboost face detector based on Haar-like features is implemented to find frontal faces, the false positive is filtered according to the skin color criterion, and the true face is used to initialize the tracking module. In hue saturation value (HSV) colorspace, the hue-saturation (H-S) histogram of face skin and the saturation-value (S-V) histogram of hair are built to produce the joint color probability density distribution image, and this is intended to realize the head tracking with arbitrary pose. During tracking, region of interest (ROI) is introduced, and the color probability density distribution of a specified background area outside the ROI is learned, similar color features in the head are suppressed according to the learning result. The background suppression step is intended to resolve the problem that the tracker maybe fails when the head is distracted by backgrounds having similar colors with the head. A closed loop control model based on speed regulation is applied to drive an active camera to center the head. Once tracking drift or failure is detected, the system stops tracking and returns to the face detection module. Our experimental results show that the presented system is well suitable for tracking head with arbitrary pose in dynamic complex environments, also the active camera can track moving head smoothly and stably. The system is computationally efficient and can run in real-time completely.
A Method for Accurate Localization of Facial Features

Zhihui Jiao,Weize Zhang,Ruofeng Tong

DOI: https://doi.org/10.1109/ETCS.2009.585

2009-01-01

Abstract:Facial features localization, as an important technique in human face analyzing, is specialized in searching for facial features (eyes, nose, mouth, etc) within a given region in an image. Although there are many methods to locate the facial features, most of them are computationally expensive. This paper presents a simple method that uses spatial filter for accurate feature detection in face images. When using this algorithm in complex images (images that contain both human faces and some other objects), we find that, there are many false positive candidates. In order to eliminate these candidates, we use a new variant of AdaBoost classifiers based face detection to detect the face regions, thus limit the regions that feature localization algorithm analyzed.
Video Based Head Detection and Tracking Surveillance System

Di Xie,Lu Dang,Ruofeng Tong

DOI: https://doi.org/10.1109/fskd.2012.6234136

2012-01-01

Abstract:In this paper, we present a novel system that acquires clear human face or head in video stream from a single surveillance camera and applies several state-of-the-art computer vision algorithms to generate real-time human head detection and tracking results. The detection results are obtained using histogram of gradients (HoG) feature powered by GPU and the false positives are filtered out by motion and appearance likelihoods. Then all the true positives are tracked by a track algorithm based on earth mover's distance (EMD) and SURF points. Our experiment results show that the proposed system makes it possible to accomplish robust detection and tracking performance in most surveillance scenes.
REAL TIME FACE TRACKING IN EMBEDDED ENVIRONMENT

Ji Cunmei,Chen Wei

DOI: https://doi.org/10.3969/j.issn.1000-386X.2011.04.042

2011-01-01

Abstract:For solving the face tracking issue in complicated background and varying illuminating conditions,this paper presents a real-time face tracking method adapted to the embedded environment.Frame difference is used in the method to check movement region.Then AdaBoost face detection is applied in movement region and is followed with the extraction of face feature points.Finally,Pyramidal Lucas-Kanade method with distance constraint is used to track face feature points.When facial feature points are lost seriously,the method re-initialises the features and tracks.Experimental results show that our method has robust tracking performance.Besides,it can track faces in real time in embedded environment.
Human Face Detection and Feature Tracking in a Bottom-Up Way

JIN Cheng,BU Jia-jun,CHEN Hua,CHEN Chun,SONG Ming-li,WU Qi

DOI: https://doi.org/10.3785/j.issn.1008-973x.2008.05.014

2008-01-01

Abstract:A robust automatic tracking method of human face feature points was proposed to enhance the facial feature tracking performance.By training the algorithm with 497 different faces of different ages,genders and face shapes,the algorithm first computed a coarse position of the human face by a trained skin model.A bottom-up scheme was applied to find the face components with obvious features that were firstly tracked by active appearance model(AAM).These components were organized as combinations of parts and then all of face organs with different weights to enhance the recognition and tracking performance.Compared with traditional methods,this method no longer uses a unified locating method,but a layer-by-layer one,and adjusts the accuracy in each layer,thus generates better tracking results.
Research and Realization on Moving Object Detection and Tracking Methods of Human

徐雷,裴海龙

DOI: https://doi.org/10.3969/j.issn.1004-373x.2010.04.040

2010-01-01

Abstract:Through a section of camera video,the moving human bodies are detected and tracked.In target detection,it obtains image sequence,gets the background using adaptive background extraction method.In accordance to the segmentation threshold of the partition separating the objects and images,it segments the images,extracts moving field,and detects the human bodies' moving targets.In the target tracking,it chooses the movement tracking system based on Kalman filtering.By estimating the next position of moving targets,it tracks moving targets with real-time.In this paper,it builds the model and algorithm on the experimental platform in the Linux open-source use of Intel's OpenCV library.Several rounds of simulation tests show that the use of Kalman filter can be a very good solution to the experiment.When two people shake hands with the issue of inter-shading,it solves the problem well,gets very good tracking of moving targets and fast processing speed.So,the system meets the real-time requirements under normal circumstances.
A System for Human Face and Facial Feature Location.

Jun Miao,Hong Liu,Wen Gao,Hongming Zhang,Gang Deng,Xilin Chen

DOI: https://doi.org/10.1142/s0219467803001111

2003-01-01

Abstract:This paper presents an implementation of a system designed for the location of human faces and facial features such as pupils, eyes, nose and mouth. The kernel of the system is an integration of several algorithms, such as the human face center-of-gravity template, illumination compensation, and so on. A false-face removal algorithm is proposed in this paper specially for the distinguishing of cartoon faces from true faces. The testing experiments of the system have produced quite good results, with the average detection accuracy rates for face detection and facial feature location being 97.8% and 87.5% respectively.
Detection and Tracking of Facial Features under a Complex Background.

L Zhuang,GY Xu,HZ Ai,G Song

DOI: https://doi.org/10.1117/12.469544

2002-01-01

Abstract:A "coarse-to-fine" facial feature detection and tracking system which is used under complex background is introduced in this paper. The system uses stereo cameras for video input. By stereovision technique, face is roughly and quickly segmented from complex background. Then, the multiple template matching method is applied to find the accurate face region from this rough segmentation. Facial organ candidates are extracted from the detected face region at a specific scale space called organ scale for Sobel filter. Finally, eyes, nose and mouth corners are detected. Techniques for checking and correcting errors in facial feature detection based on multiple cues are developed to make the algorithm more robust in facial feature detection and tracking in video sequence. Experiments on 189 video sequences demonstrate its effectiveness.
Real-Time facial expression recognition system based on HMM and feature point localization

Yumei Fan,Ning Cheng,Zhiliang Wang,Jiwei Liu,Changsheng Zhu

DOI: https://doi.org/10.1007/11573548_27

2005-01-01

Abstract:It is difficult for computer to recognize facial expression in real-time. Until now, no good method is put forward to solve this problem in and abroad. In this paper, we present an effective automated system that we developed to recognize facial gestures in real-time. According to psychologists’ facial expression classification, we define four basic facial expressions and localize key facial feature points exactly then extract facial components’ contours. We analyze and record facial components’ movements using information in sequential frames to recognize facial gestures. Since different facial expressions can have some same movements, it is necessary to use a good facial expression model to describe the relation between expression states and observed states of facial components’ movements for achieving a good recognition results. HMM is such a good method which can meet our requirement. We present a facial expression model based on HMM and get good real-time recognition results.
Real-Time Facial Features Tracker With Motion Estimation And Feedback

Rh Liang,C Chen,Jj Bu

DOI: https://doi.org/10.1109/ICSMC.2003.1244471

2003-01-01

Abstract:Real-time face tracking automatically is a great challenge in Computer Vision and Computer Graphics. We develop a system to track face automatically by integrating auto-generation of features of first frame, feature correspondence and Kalman filter based on face attribution and motion estimation. First, Facial features of the first frame are acquired automatically by face detachment and Plessey corner detector according to FDP in MPEG-4 based on anatomical knowledge and general 3D model. And then feature correspondence is obtained by maximizing the cross-correlation, and Kalman filter. Face detection automatically makes full use of the knowledge of 3D general model and face attribute, and face tracking is more efficient by using motion estimation. Experimental results show the high prospect of this algorithm.
Video Tracked Facial Expression Animation

L Mei,Jh Chen,Hj Bao,Qs Peng

2001-01-01

Abstract:In this paper, we present a new technique to automatically recover the face pose and facial expression from a video sequence. Based on image-based modeling technique, a personalized 3D face model is first reconstructed from two orthogonal images. The face model implanted with 18 muscular vectors is then correspondingly deformed to match each frame using a continuous optimization technique. Our method has several advantages over previous techniques. It is robust to deal with large head motions, and tracking facial features is much stable and precise over a large number of frames due to its full consideration of the 3D information of the head. The algorithm has been applied to automatically generate performance driven expression animations from video sequences.
REAL-TIME HUMAN FACE TRACKING IN COLOR IMAGES

Ming-Bao LIU,Hong-Xun YAO,Wen GAO

DOI: https://doi.org/10.3321/j.issn:0254-4164.1998.06.007

1998-01-01

Chinese Journal of Computers

Abstract:This paper presents a method of real-time human face tracking in color images. The tracking model contains Human Face Color Model (HFCM) and Motion Model. In HFCM, it first transforms images from RGB Space onto Chroma Space, then adopts quadrature of histogram to characterize human face. Motion model consists of motion detection and motion prediction in order to decrease searching region and raise tracking speed. Finally, an on-line system which is realized using the above two models is introduced. Experimental results show that in complex backgrounds, the tracking model presented in this paper could track human face's free movement in real-time.
Robust Real-Time Face Tracking And Modeling From Video

Rh Liang,C Chen,Zg Pan,Jj Bu

DOI: https://doi.org/10.1007/3-540-44839-X_13

2003-01-01

Abstract:Real-time face tracking and 3D reconstruction from video is a challenge in computer graphics and computer vision. We develop a system to track face by integrating image pyramid algorithm and Kalman filter. First, Facial features of the first frame are acquired automatically by Plessey corner detector according to FDP in MPEG-4 and FACS based on anatomical knowledge and general 3D model. And then corner disparity is obtained by image pyramid algorithm and Kalman filter. Kalman filter is employed to resolve the tracking speed and occlusion problems. Finally, 3D model is reconstructed by SfM (Structure from motion). Experimental results show the high prospect of this algorithm, and the two issues of real-time face tracking and modeling are resolved in our algorithm.
Real-time Localization of 3D Facial Landmarks

Xiaobo Zhang,Gang Pan,Haoyi Ren,Yueming Wang

DOI: https://doi.org/10.3969/j.issn.1003-9775.2013.09.009

2013-01-01

Abstract:In order to automatically find facial landmarks of a 3D facial shape, such as nose-tip and inner eye corners, this paper presents an effective approach to automatically detect landmarks of a 3D face in real time. A local surface descriptor based on partition and histogram, named sphere partition histogram descriptor, is designed to characterize local surface at a point on 3D face shape. Then we exploit the SPIDER descriptor to localize facial landmarks. The proposed algorithm is suitable for acceleration by GPU parallel computing. The experiments on FRGC v1.0 and BU-3DFE show that our algorithm outperforms other existing methods on 3D facial landmarks localization.
A universal facial organs localization method for infrared face

ZHANG Tao,ZHAO Yang,HONG Wenxue,Xulong Liu

DOI: https://doi.org/10.13741/j.cnki.11-1879/o4.2012.02.002

2012-01-01

Optical Technique

Abstract:Infrared face is one of active areas in infrared imaging,but the facial organs localization as its basis issues is lack of research.A universal method is proposed which localizes facial organs based on temperature distribution specificity and edge formed by variety of temperature.In this method,the organ which lies in strongly temperature specify zones like nose is located first,and then takes it as reference to locate other organs combined with image edge information.The experiments show that the average precision achieves 90% at least,which means that the method can be used in applications.At the same time,this method not only can locate regular eyes,nose,mouth,but also can locate brow bone and iris.So it can be used in more applications.
Complete Automatic Target Recognition System for Real-Time Human Face Images

HS Liu,MX Wu,GF Jin,G Cheng,QS He

DOI: https://doi.org/10.1117/12.323240

1998-01-01

Abstract:In this paper, a complete human face automatic target recognition system is presented. Input images of human faces are grabbed at standard video rates and recognized in real- time. The database contains 200 face images stored in computer memory in advance. The system includes a feature point extractor, a normalization algorithm, an encoding module, an optical recognizer which is based on hit/miss transform and an incoherent correlator, and a postprocessing module. When a real-time face image is picked up by CCD camera, three reference points including two internal corners of both eyes and the mouth center, are extracted automatically for normalizing use. Then the face image is normalized to a fixed scale and posture by using the affine transform. The normalized image will then be encoded to an original-complementary composite encoding image and be sent to a liquid crystal display panel, which is used here as a real-time spatial light modulator, to be recognized by the optical recognizer. Experimental results have shown that the system has an accuracy over 94%. Its tolerance abilities to head turning, nodding, and tilting are 20 degree(s), 5 degree(s), and 15 degree(s) respectively. It is also tolerable to noise disturb up to 30%, to image lost up to 40%, and even to different expressions such as seriousness, smile, and astonishment.

Facetracker: A Human Face Tracking And Facial Organ Localizing System

Real-time Detection and Tracking Algorithm Based on the Color and Character of Human Face

Robust Human Tracking Via Key Face Information.

A Single-Camera Gaze Tracking System under Natural Light

A Simple 3d Face Tracking Method Based On Depth Information

Real-time Follow-Up Head Tracking in Dynamic Complex Environments

A Method for Accurate Localization of Facial Features

Video Based Head Detection and Tracking Surveillance System

REAL TIME FACE TRACKING IN EMBEDDED ENVIRONMENT

Human Face Detection and Feature Tracking in a Bottom-Up Way

Research and Realization on Moving Object Detection and Tracking Methods of Human

A System for Human Face and Facial Feature Location.

Detection and Tracking of Facial Features under a Complex Background.

Real-Time facial expression recognition system based on HMM and feature point localization

Real-Time Facial Features Tracker With Motion Estimation And Feedback

Video Tracked Facial Expression Animation

REAL-TIME HUMAN FACE TRACKING IN COLOR IMAGES

Robust Real-Time Face Tracking And Modeling From Video

Real-time Localization of 3D Facial Landmarks

A universal facial organs localization method for infrared face

Complete Automatic Target Recognition System for Real-Time Human Face Images