Sequence Mouth Shape Classification for Speechreading

单卫,姚鸿勋,高文

DOI: https://doi.org/10.3969/j.issn.1003-0077.2002.01.006

2002-01-01

Abstract:This paper describes an approach of classifying the continuous mouth shapes,which are obtained from sequence images of Chainese pronunciation of vowel and consonant.Based on the audiovisual bimodal database,we present a classifying method called Two Step Classification.First,we located the lip and extract the features using adaptive chromatic filter model.Then,relying on the features chosen,we classify the sequence mouth shapes into 15 categories.The purpose of mouth shape classification is to confirm the mumber of states,shrink searching space and expedite convergence speed for lipreading recognition.