Abstract:The problem of fast and robust lip locating becomes more and more important in multimode interfaces such as lip reading, facial expression recognition, lip motion synthesis and Synthetic/Natural Hybrid Coding (SNHC) in MPEG4. However, locating and tracking lip motion accurately are very difficult and challenging because the lip contours of different people vary greatly and are affected by lip variations, head movement and illuminant conditions while a speaker is uttering. A fast and robust lip detecting and locating approach which combines the information of lip color in color space and the geometrical feature of lip color in human face space is proposed in this paper. First, the Fisher transform with constraints is proposed to enhance the lip image. Then, the geometrical feature of lips in human face is proposed to increase the accuracy and speed of lip locating. Two key characteristics were found. One is that the ratio of lip color area to that of skin color is almost unchanged. This characteristic is used to adaptively set the threshold to separate the lip color and skin color. The other is the linear relation between parameters of inner lips and parameters of outer lips. The parameters of inner lips can be predicted by parameters of outer lips to overcome the local minimum problem of locating inner lips. The experimental results have shown that the approach to locate lips is very efficient both in locating speed and locating accuracy.

Lip Contour Extraction of RGB-based Improved Region Growing Algorithm

Lip Detecting Algorithm Based on Chroma Distribution Diversity

Interactive Color Image Segmentation by Region Growing Combined with Image Enhancement Based on Bezier Model

Accurate and real-time lip contour extraction based on constrained contour growing

Face Contour Extraction Algorithm Based on Skin Luma and Depth Information

Lip Contour Extraction Based on Support Vector Machine Add Support

Robust Lip Segmentation Based on Complexion Mixture Model.

Optimization of Lip Contour Estimation

Region-of-interest based flower images retrieval

Lip Analysis in Traditional Chinese Medicine.

Lip Segmentation Based on Facial Complexion Template

A Flower Image Retrieval Method Based on ROI Feature

Region Labeling Algorithm Based on Boundary Tracking for Binary Image

An Approach to Robust and Fast Locating of Lip Motion

An Inner Contour Based Lip Moving Feature Extraction Method for Chinese Speech

Lip-Movement Features Extraction and Recognition Based on Chroma Analysis

A Fast Extracting Method for the Region of Interest of Copper Image

A Novel Color Image Segmentation Algorithm Based on Vector Quantization and Region Growing

A Novel Color Image Segmentation Based on Color Information and Region Growing

A color image segmentation algorithm based on region growing

Method of Deformable Optimum Threshold for Lipreading