Abstract:A method was developed for automatic recognition of syllable tone types in continuous speech of Mandarin by integrating two techniques, tone nucleus modeling and neural network classifier. The tone nucleus modeling considers a syllable F0 contour as consisting of three parts: onset course, tone nucleus, and offset course. Two courses are transitions from/to neighboring syllable F0 contours, while the tone nucleus is intrinsic part of the F0 contour. By viewing only the tone nucleus, acoustic features less affected by neighboring syllables are obtained. When using the tone nucleus modeling, automatic detection of tone nucleus comes crucial. An improvement was added to the original detection method. Distinctive acoustic features for tone types are not limited to F0 contours. Other prosodic features, such as waveform power and syllable duration, are also useful for tone recognition. Their heterogeneous features are rather difficult to be handled simultaneously in hidden Markov models (HMM), but are easy in neural networks. We adopted multi-layer perceptron (MLP) as a neural network. Tone recognition experiments were conducted for speaker dependent and independent cases. In order to show the effect of integration, experiments were conducted also for two baselines: HMM classifier with tone nucleus modeling, and MLP classifier viewing entire syllable instead of tone nucleus. The integrated method showed 87.1 % of tone recognition rate in speaker dependent case, and 80.9% in speaker independent case, which was about 10% relative error reduction as compared to the baselines.

Tone nucleus modeling for Chinese lexical tone recognition

Tone nucleus-based multi-level robust acoustic tonal modeling of sentential F0 variations for Chinese continuous speech tone recognition

Robust Acoustic Modeling of Contextual Tonal F0 Variations on the Basis of Tone Nucleus Framework

Tone Recognition of Continuous Mandarin Speech Based on Tone Nucleus Model and Neural Network.

TONE RECOGNITION OF CHINESE CONTINUOUS SPEECH

Modeling Carryover and Anticipation Effects for Chinese Tone Recognition.

Generation of Fundamental Frequency Contours for Mandarin Speech Synthesis Based on Tone Nucleus Model

Exploiting Prosodic and Lexical Features for Tone Modeling in A Conditional Random Field Framework

Automatic Extraction Of Tone Command Parameters For The Model Of F(0) Contour Generation For Standard Chinese

A Multi-Space Distribution (MSD) Approach to Speech Recognition of Tonal Languages

Computational Modelling of Tone Perception Based on Direct Processing of F0 Contours

Tone pronunciation quality scoring of Mandarin multi-syllable words

Tone Modeling for Continuous Mandarin Speech Recognition

Improved Mandarin Speech Recognition by Lattice Rescoring with Enhanced Tone Models

An improved tone labeling and prediction method with non-uniform segmentation of F0 contour

Competing Model Based Tone Evaluation for Mandarin Speech

An Investigation of the Target Approximation Model for Tone Modeling and Recognition in Continuous Mandarin Speech.

A Method for Automatic Tone Command Parameter Extraction for the Model of F 0 Contour Generation for Mandarin

A Method for Automatic Tone Command Parameter Extraction for the Model of F0 Contour Generation for Mandarin

Robust F0 Modeling for Mandarin Speech Recognition in Noise.

A PITCH TARGET APPROXIMATION MODEL FOR F0 CONTOURS IN MANDARIN