Abstract:Visual speech-lip reading, making the computer understands what do speakers want to express through observing the lip direction of them. The most simply method of lip reading in early stage is to compare between characters from the frozen pictures and templates being stored. It neglects the character is changing with time. This method is very simply, but it only can classify the simple elements not the words, so it couldn't render great serves to speech recognition. Afterwards the adoption of behavioral characteristics is becoming more widespread. Because of the superior of Hidden Markov model (HMM), it can be applied in speech recognition widely. In recent years, it is also used in the research of lip-reading recognition. The classical HMM model makes two hypotheses: hidden expropriation hypothesis: the state at t+1 is only conditioned by the state at t, not the state before; the expropriation hypothesis from hidden state to visible state: the visible state at t only conditioned by the hidden state at t, not the state before. Such kind of hypothesis is not very reasonable in some practical application (such as lip-reading). In some kind condition, the state at t is not only conditioned by t-1, but also t-2. Therefore this thesis revises the assumed condition classical HMM to derive a new HMM model and algorithm, and applying it into lip-reading recognition to increase the discrimination.

From Linear Prediction HMM to a New Combined Model for Speech Recognition

A New Combined Model of Statics-Dynamics of Speech.

A combined model of statics-dynamics of speech optimized using maximum mutual information

Discriminative Combination of Multiple Linear Predictions for Speech Recognition.

Parametric model of introducing inter-frame correlation information into hidden markov model for speech recognition

A New Method for Discriminative Model Combination in Speech Recognition

An Appropriate Parallel HMM for Speaker-Independent Speech Recognition

An New Method Used in HMM for Modeling Frame Correlation.

Probabilistic Speaker-Class Based Acoustic Modeling for Large Vocabulary Continuous Speech Recognition

Improvement of hidden Markov model (HMM) for speech recognition

Improved Speech Recognition Using Discriminative Integration of Multiple Local Classifiers in Lattice Rescoring

Research on Polynomial-Fitting Speech-Trajectory Model in Chinese Continuous Speech Recognition

Lipreading HLM and Text Flow Analysis

Improved HMM Model Using Spatial Correlation

A kind of improving HMM model and using in the visual speech recognition

A New Hybrid Hmm/Ann Model For Speech Recognition

Non-linear probability estimation method used in HMM for modeling frame correlation

Speaker-independent speech recognition based on HMM state-restructuring method

The Hidden Markov Model of co-articulation and its application to the continuous speech recognition

Duration-Distribution-Based HMM for Speech Recognition

A Hybrid Speech Recognition System Based on HMM/ANN