Abstract:Tone study is very important for Mandarin speech recognition. In this paper, a Mixture Stochastic Polynomial Tone Model (MSPTM) is proposed for tone modeling in continuous Mandarin speech. In this model the pitch contour, main representative of tone pattern, is described as a mixed stochastic trajectory. The mean trajectory is represented by a polynomial function of normalized time while the variance is time varying. Effective training and tone recognition algorithms were developed. The experimental results based on the proposed MSPTM showed 40.7% tone recognition error rate reduction relative to the traditional Hidden Markov Model (HMM) tone model. We also present a decision tree based approach to learning the tone pattern variation in continuous speech. The phonetic and linguistic factors that may affect the tone patterns were taken into consideration while constructing the tree. After the tree was established, 28 different tone patterns were obtained. We found that in addition to the tone of the neighboring syllable, Consonant/Vowel type of the syllable and the position of the syllable in the utterance also made important contributions to tone pattern variations in continuous speech. Finally, a new approach of integrating tone information into the search process at word level is discussed. Experiments on continuous Mandarin speech recognition showed that the new tone model and tone information integration method were efficient, achieving a 16.2% relative character error rate reduction.

Improvement of hidden Markov model (HMM) for speech recognition

Parametric model of introducing inter-frame correlation information into hidden markov model for speech recognition

An New Method Used in HMM for Modeling Frame Correlation.

Duration-Distribution-Based HMM for Speech Recognition

Chinese Vowels Recognition Method Based on Non-Homogeneous Hidden Markov Model

Noisy Chinese Digit String Speech Recognition Based on Tone Modeling

Duration Model for post-processing in a Mandarin speech recognition system

GMM-HMM Acoustic Model Training by a Two Level Procedure with Gaussian Components Determined by Automatic Model Selection

An inhomogeneous HMM speech recognition algorithm

Discriminative Dynamic Gaussian Mixture Selection with Enhanced Robustness and Performance for Multi-Accent Speech Recognition

Hybrid speech recognition based on improved hidden markov model and neural network

An Improved Automatic Speech Recognition System by Modifying the Hidden Markov Model(HMM) Based on Feedback Adjust

Improving of Acoustic Model for the Mongolian Speech Recognition System

An Improved Viterbi Algorithm and Speech Recognition with State Duration Considered

A kind of improving HMM model and using in the visual speech recognition

Research of relationship between weight coefficient of product HMM and instantaneous SNR in bimodal speech recognition

A New Method in Hidden Markov Model for Modeling Frame Correlation

Tone Modeling for Continuous Mandarin Speech Recognition

A Multi-Space Distribution (MSD) Approach to Speech Recognition of Tonal Languages

A New Combined Model of Statics-Dynamics of Speech.

A fused hidden Markov model with application to bimodal speech processing