Abstract:Tone study is very important for Mandarin speech recognition. In this paper, a Mixture Stochastic Polynomial Tone Model (MSPTM) is proposed for tone modeling in continuous Mandarin speech. In this model the pitch contour, main representative of tone pattern, is described as a mixed stochastic trajectory. The mean trajectory is represented by a polynomial function of normalized time while the variance is time varying. Effective training and tone recognition algorithms were developed. The experimental results based on the proposed MSPTM showed 40.7% tone recognition error rate reduction relative to the traditional Hidden Markov Model (HMM) tone model. We also present a decision tree based approach to learning the tone pattern variation in continuous speech. The phonetic and linguistic factors that may affect the tone patterns were taken into consideration while constructing the tree. After the tree was established, 28 different tone patterns were obtained. We found that in addition to the tone of the neighboring syllable, Consonant/Vowel type of the syllable and the position of the syllable in the utterance also made important contributions to tone pattern variations in continuous speech. Finally, a new approach of integrating tone information into the search process at word level is discussed. Experiments on continuous Mandarin speech recognition showed that the new tone model and tone information integration method were efficient, achieving a 16.2% relative character error rate reduction.

STUDY ON FRAMEWORK FOR CHINESE PRONUNCIATION VARIATION MODELING

Modeling Syllable-Based Pronunciation Variation for Accented Mandarin Speech Recognition

MANDARIN PRONUNCIATION VARIATION MODELING 1

Pronunciation Variation Modeling For Mandarin With Accent

Lightly supervised acoustic model training for mandarin continuous speech recognition

Modeling Pronunciation Variation Using Context-Dependent Weighting and B/s Refined Acoustic Modeling.

Mandarin Pronunciation Modeling Based on CASS Corpus.

Mixed Models Based Pronunciation Evaluation of Mandarin Tone.

Effective Acoustic Modeling for Pronunciation Quality Scoring of Strongly Accented Mandarin Speech

PHMM Based Asynchronous Acoustic Model for Chinese Large Vocabulary Continuous Speech Recognition

Main vowel domain tone modeling with lexical and prosodic analysis for Mandarin ASR

Tone Modeling for Continuous Mandarin Speech Recognition

An English Pronunciation Evaluation Model Based on Acoustic Phonetics Features

An Innovative Prosody Modeling Method for Chinese Speech Recognition

Context Dependent Syllable Acoustic Model For Continuous Chinese Speech Recognition

An Acoustic-Phonetic Analysis of Large Vocabulary Continuous Mandarin Speech Recognition for Non-Native Speakers

Exploiting Prosodic and Lexical Features for Tone Modeling in A Conditional Random Field Framework

Initial/final acoustic model based on separating nasal coda in Chinese Putonghua speech recognition

Research on Context-Dependent Acoustical Unit (Triphone) for Mandarin Continuous Speech Recognition

Mandarin Speech Recognition for Nonnative Speakers Based on Pronunciation Dictionary Adaptation

A study on speaker and session variability in speaker recognition of Chinese whispered speech