Abstract:A method was developed for automatic recognition of syllable tone types in continuous speech of Mandarin by integrating two techniques, tone nucleus modeling and neural network classifier. The tone nucleus modeling considers a syllable F0 contour as consisting of three parts: onset course, tone nucleus, and offset course. Two courses are transitions from/to neighboring syllable F0 contours, while the tone nucleus is intrinsic part of the F0 contour. By viewing only the tone nucleus, acoustic features less affected by neighboring syllables are obtained. When using the tone nucleus modeling, automatic detection of tone nucleus comes crucial. An improvement was added to the original detection method. Distinctive acoustic features for tone types are not limited to F0 contours. Other prosodic features, such as waveform power and syllable duration, are also useful for tone recognition. Their heterogeneous features are rather difficult to be handled simultaneously in hidden Markov models (HMM), but are easy in neural networks. We adopted multi-layer perceptron (MLP) as a neural network. Tone recognition experiments were conducted for speaker dependent and independent cases. In order to show the effect of integration, experiments were conducted also for two baselines: HMM classifier with tone nucleus modeling, and MLP classifier viewing entire syllable instead of tone nucleus. The integrated method showed 87.1 % of tone recognition rate in speaker dependent case, and 80.9% in speaker independent case, which was about 10% relative error reduction as compared to the baselines.

Automatic Pronunciation Evaluation Of Non-Native Mandarin Tone By Using Multi-Level Confidence Measures

Mixed Models Based Pronunciation Evaluation of Mandarin Tone.

An Mandarin Pronunciation Quality Assessment System Using Two Kinds of Acoustic Models

Experimental Investigation of Mandarin Pronunciation Quality Assessment System

Improving Mandarin Tone Recognition Based on DNN by Combining Acoustic and Articulatory Features Using Extended Recognition Networks

Tone pronunciation quality scoring of Mandarin multi-syllable words

Visualization of Mandarin Chinese Tone Production of Japanese L2 Learners for Evaluation

Effective Acoustic Modeling for Pronunciation Quality Scoring of Strongly Accented Mandarin Speech

Integrated Tone Evaluation in Mandarin CALL Systems Using Competing Model Based Approach

A Computer-Assisted Tool for Automatically Measuring Non-Native Japanese Oral Proficiency

Automatic assessment of oral Mandarin proficiency based on speech recognition and evaluation

A novel tone evaluation algorithm for Chinese continuous speech

An SVM-Based Mandarin Pronunciation Quality Assessment System.

Tone Recognition of Continuous Mandarin Speech Based on Tone Nucleus Model and Neural Network.

Automatic Mispronunciation Detection for Mandarin Chinese

Automatic Speaker-level Pronunciation Assessment of L2 Speech Using Posterior Probabilities from Multiple Utterances

Competing Model Based Tone Evaluation for Mandarin Speech

Comparison of Pronunciation Scores in Spoken Language Learning System

Automatic spoken English test for Chinese learners

A Study On Robust Detection Of Pronunciation Erroneous Tendency Based On Deep Neural Network

An Investigation of the Target Approximation Model for Tone Modeling and Recognition in Continuous Mandarin Speech.