Abstract:Tone plays an important role in recognizing spoken tonal languages like Chinese. However, the F0 contour discontinuity between voiced and unvoiced segments has traditionally been a bottleneck in modeling tone contour for automatic speech recognition and synthesis and various heuristic approaches were proposed to get around the problem. The Multi-Space Distribution (MSD) was proposed by Tokuda et.al. and applied to HMM-based speech synthesis, which models the two probability spaces, discrete for unvoiced region and continuous for voiced F0 contour, in a linearly weighted mixture. We extend the MSD to tone modeling for speech recognition applications. Specifically, modeling tones in speaker-independent, spoken Chinese is formulated and tested in a Mandarin speech database. The tone features and spectral features are further separated into two streams and stream-dependent models are built to cluster the two features into separated decision trees. The recognition results show that the ultimate performance of tonal syllable error rate can be improved from toneless baseline system to the MSD based stream-dependent system, 50.5% to 36.1% and 46.3% to 35.1%, for the two systems resulted from using two different phone sets. The absolute tonal syllable error rate improvement of the new approach is 5.5% and 6.1%, comparing with the conventional tone modeling.

A Method To Train Tied Subspace Distribution HMM

HMM training method based on evolutionary computation and MDI in speech recognition

The Student's T -Hidden Markov Model with Truncated Stick-Breaking Priors.

MCE-based Training of Subspace Distribution Clustering HMM

A Parameter Transfer Method for HMM-DNN Heterogeneous Model with the Scarce Mongolian Data Set

Product HMM-based Training Method for Acoustic Model with Multiple-Size Units

Fuzzy C-Means Clustering Based Phonetic Tied-Mixture HMM in Speech Recognition

A Fuzzy-Clustering Analysis Based on Phonetic Tied-Mixture HMM

Improvement of hidden Markov model (HMM) for speech recognition

A Method for Determination on HMM Distance Threshold

GMM-HMM Acoustic Model Training by a Two Level Procedure with Gaussian Components Determined by Automatic Model Selection

An New Method Used in HMM for Modeling Frame Correlation.

Bayesian Subspace Hidden Markov Model for Acoustic Unit Discovery

Training Discriminative HMM by Optimal Allocation of Gaussian Kernels

A Multi-Space Distribution (MSD) Approach to Speech Recognition of Tonal Languages

Two Phases Hybrid Algorithm for DHMM Training

Subspace construction and selection for speaker recognition

The Description of the Intra-State Feature Space in Speech Recognition

Duration-Distribution-Based HMM for Speech Recognition

A Full Training Framework of Cross-Stream Dependence Modelling for HMM-based Singing Voice Synthesis

Feature-Space Transform Tying in Unified Acoustic-Articulatory Modelling for Articulatory Control of HMM-Based Speech Synthesis.