Abstract:Tone study is very important for Mandarin speech recognition. In this paper, a Mixture Stochastic Polynomial Tone Model (MSPTM) is proposed for tone modeling in continuous Mandarin speech. In this model the pitch contour, main representative of tone pattern, is described as a mixed stochastic trajectory. The mean trajectory is represented by a polynomial function of normalized time while the variance is time varying. Effective training and tone recognition algorithms were developed. The experimental results based on the proposed MSPTM showed 40.7% tone recognition error rate reduction relative to the traditional Hidden Markov Model (HMM) tone model. We also present a decision tree based approach to learning the tone pattern variation in continuous speech. The phonetic and linguistic factors that may affect the tone patterns were taken into consideration while constructing the tree. After the tree was established, 28 different tone patterns were obtained. We found that in addition to the tone of the neighboring syllable, Consonant/Vowel type of the syllable and the position of the syllable in the utterance also made important contributions to tone pattern variations in continuous speech. Finally, a new approach of integrating tone information into the search process at word level is discussed. Experiments on continuous Mandarin speech recognition showed that the new tone model and tone information integration method were efficient, achieving a 16.2% relative character error rate reduction.

An Innovative Prosody Modeling Method for Chinese Speech Recognition

Modeling Prosody Patterns for Chinese Expressive Text-to-speech Synthesis

Tone Modeling for Continuous Mandarin Speech Recognition

Evaluating Prosody of Mandarin Spe

Maximum Entropy Based Tone Modeling for Mandarin Speech Recognition

Modeling prosody pattern of Chinese expressive speech and its application in personalized speech conversion

Prosodic Modeling with Rich Syntactic Context in HMM-based Mandarin Speech Synthesis

Main vowel domain tone modeling with lexical and prosodic analysis for Mandarin ASR

Study on the Integration of Phonetic and Prosodic Probability Based on 3-Dimension Viterbi Search

Exploiting Prosodic and Lexical Features for Tone Modeling in A Conditional Random Field Framework

Study of Prosody Model on Chinese Speech Synthesis Based on the Classification of Syllabic Prosody Features

A New Prosodic Strength Calculation Method for Prosody Reduction Modeling

Refining Context-Dependent Tonal Acoustic Modeling in Mandarin LVCSR

A Superposed Prosodic Model for Chinese Text-To-Speech Synthesis

Towards Fine-Grained Prosody Control for Voice Conversion

Improved Mandarin Speech Recognition by Lattice Rescoring with Enhanced Tone Models

HIERARCHICAL PROSODY MODELING FOR NON-AUTOREGRESSIVE SPEECH SYNTHESIS

A Novel Prosody Adaptation Method for Mandarin Concatenation-Based Text-to-speech System

Prosodic Annotation Enriched Statistical Machine Translation

Effective Acoustic Modeling for Pronunciation Quality Scoring of Strongly Accented Mandarin Speech

Prosody Variation: Application to Automatic Prosody Evaluation of Mandarin Speech