Abstract:The problem of fast and robust lip locating becomes more and more important in multimode interfaces such as lip reading, facial expression recognition, lip motion synthesis and Synthetic/Natural Hybrid Coding (SNHC) in MPEG4. However, locating and tracking lip motion accurately are very difficult and challenging because the lip contours of different people vary greatly and are affected by lip variations, head movement and illuminant conditions while a speaker is uttering. A fast and robust lip detecting and locating approach which combines the information of lip color in color space and the geometrical feature of lip color in human face space is proposed in this paper. First, the Fisher transform with constraints is proposed to enhance the lip image. Then, the geometrical feature of lips in human face is proposed to increase the accuracy and speed of lip locating. Two key characteristics were found. One is that the ratio of lip color area to that of skin color is almost unchanged. This characteristic is used to adaptively set the threshold to separate the lip color and skin color. The other is the linear relation between parameters of inner lips and parameters of outer lips. The parameters of inner lips can be predicted by parameters of outer lips to overcome the local minimum problem of locating inner lips. The experimental results have shown that the approach to locate lips is very efficient both in locating speed and locating accuracy.

Lip Detecting Algorithm Based on Chroma Distribution Diversity

Skin Detection Using Color, Texture and Space Information

A Real Time Lip Detection Method In Lipreading

Face Detection Method Based on Multi-Skin Color Space and AdaBoost Algorithm

Skin detection using color, texture and neighborhood information

Estimation of Skin Pigment Concentration by Simulating Skin Color

Face detection and location based on skin chrominance and lip chrominance transformation from color images

Lip Analysis in Traditional Chinese Medicine.

Multi-feature Based Integrated Skin Detection Method

A Real Time Face Detection Method in Human-Machine Interaction

Human face detection under weak light based on depth information

Face Locating and Tracking Method Based on Chroma Transform in Color Images

Real-time Detection and Tracking Algorithm Based on the Color and Character of Human Face

Color-based Skin Detection:A Survey

A Skin Color Model Based on Modified GLHS Space for Face Detection.

Lip Segmentation Based on Facial Complexion Template

An Approach to Robust and Fast Locating of Lip Motion

Robust Lip Segmentation Based on Complexion Mixture Model.

An Adaptive Skin Detection Approach of Face Images with Unequal Luminance, Color Excursion, and Background Interference

A Novel Skin Clustering Method for Face Detection

Lip-Movement Features Extraction and Recognition Based on Chroma Analysis