Mouth-Shape Classification And Recognition For Lipreading

Hongxun Yao,Wen Gao,Wei Shan,Xiujuan Chai
2002-01-01
Abstract:This paper puts forward the concept of mouth basic shape, and describes an approach of self-organizing feature maps combining k-means to obtain the basic shapes. The basic mouth shapes are the gist which breaks away different states during continuous speech recognition or sequence lip-movement images recognition. A recognition approach based on the mouth basic shape classified, compared with that based on feature-vector directly can reduce the cases of state branch to rather great extent, shrink the searching space and expedite the convergent rate. This paper introduces experiment results of how to select the number of original clustering center and how to select features which are benefit to mouth shape classification. Arid there are 15 categories of mouth basic shape extracted from 4680 sequence images of the Chinese language by experiments. By Chinese single syllables recognizing experiments, the approach based on mouth shape categories has a higher accurate rate and speed than that without them.
What problem does this paper attempt to address?