Abstract:Tone study is very important for Mandarin speech recognition. In this paper, a Mixture Stochastic Polynomial Tone Model (MSPTM) is proposed for tone modeling in continuous Mandarin speech. In this model the pitch contour, main representative of tone pattern, is described as a mixed stochastic trajectory. The mean trajectory is represented by a polynomial function of normalized time while the variance is time varying. Effective training and tone recognition algorithms were developed. The experimental results based on the proposed MSPTM showed 40.7% tone recognition error rate reduction relative to the traditional Hidden Markov Model (HMM) tone model. We also present a decision tree based approach to learning the tone pattern variation in continuous speech. The phonetic and linguistic factors that may affect the tone patterns were taken into consideration while constructing the tree. After the tree was established, 28 different tone patterns were obtained. We found that in addition to the tone of the neighboring syllable, Consonant/Vowel type of the syllable and the position of the syllable in the utterance also made important contributions to tone pattern variations in continuous speech. Finally, a new approach of integrating tone information into the search process at word level is discussed. Experiments on continuous Mandarin speech recognition showed that the new tone model and tone information integration method were efficient, achieving a 16.2% relative character error rate reduction.

Improving the Performance of Continuous Mandarin Digit String Recognition System by Using Tones

Use Tone Detection to Improve Performance of Mandarin Digit Speech Recognition

A Pitch Smoothing Method for Mandarin Tone Recognition

Improved Mandarin Speech Recognition by Lattice Rescoring with Enhanced Tone Models

Using Duration and Pitch for Mandarin Digit String Recognition.

An Approach of Fundamental Frequencies Smoothing for Chinese Tone Recognition

Mandarin Isolated Words Recognition Method Based on Pitch Contour

Tone Modeling for Continuous Mandarin Speech Recognition

Mandarin Tone Recognition Based on Wavelet Transform and Hidden Markov Modeling

Tone pronunciation quality scoring of Mandarin multi-syllable words

Robust F0 Modeling for Mandarin Speech Recognition in Noise.

Mandarin Continuous Digit Speech Recognition System

A New Approach for Tone Recognition of Isolated Mandarin Syllables

Mandarin tone recognition considering context information

The Research on Applying Tone Information in Mandarin Speech Recognition

Noisy Chinese Digit String Speech Recognition Based on Tone Modeling

Approaches to Pitch Processing in Tone Recognition of Mandarin

An Investigation of the Target Approximation Model for Tone Modeling and Recognition in Continuous Mandarin Speech.

A Mandarin Tone Recognition Algorithm Based on Random Forest and Features Fusion.

High Performance Digit Mandarin Speech Recognition

Tone Recognition Of Isolated Mandarin Syllables