Abstract:In this paper we present our investigation into improving the performance of our computer-assisted language learning (CALL) system through exploiting the acoustic model and features within the speech recognition framework. First, to alleviate channel distortion, speaker-dependent cepstrum mean normalization (CMN) is adopted and the average correlation coefficient (average CC) between machine and expert scores is improved from 78.00% to 84.14%. Second, heteroscedastic linear discriminant analysis (HLDA) is adopted to enhance the discriminability of the acoustic model, which successfully increases the average CC from 84.14% to 84.62%. Additionally, HLDA causes the scoring accuracy to be more stable at various pronunciation proficiency levels, and thus leads to an increase in the speaker correct-rank rate from 85.59% to 90.99%. Finally, we use maximum a posteriori (MAP) estimation to tune the acoustic model to fit strongly accented test speech. As a result, the average CC is improved from 84.62% to 86.57%. These three novel techniques improve the accuracy of evaluating pronunciation quality.

HMM Modeling Based on Mandarin Phonemes in Embedded Systems

The Optimal Selecting for HMM State-number in Mandarin Continuous Speech

Acoustic Modeling Based On Chinese Phonetics Knowledge

ACOUSTIC MODEL COMPARISONS FOR AN EMBEDDED PHONEME-BASED MANDARIN NAME DIALING SYSTEM

Duration Model for post-processing in a Mandarin speech recognition system

Chinese Vowels Recognition Method Based on Non-Homogeneous Hidden Markov Model

Phoneme Modeling Units Design for Mandarin LVCSR Systems

Discriminative Hmm Stream Model For Mandarin Digit String Speech Recognition

An Acoustic Model for English Speech Recognition Based on Deep Learning

Product HMM-based Training Method for Acoustic Model with Multiple-Size Units

Initial/final acoustic model based on separating nasal coda in Chinese Putonghua speech recognition

A Hierarchical F0 Modeling Method for HMM-based Speech Synthesis

Large Vocabulary Continuous Speech Recognition System Based on Hybrid Hidden Markov Model(HMM) and Artificial Neural Network (ANN)

PHMM Based Asynchronous Acoustic Model for Chinese Large Vocabulary Continuous Speech Recognition

Phonotactic language recognition based on DNN-HMM acoustic model

Effective Acoustic Modeling for Pronunciation Quality Scoring of Strongly Accented Mandarin Speech

Improvement of hidden Markov model (HMM) for speech recognition

GMM-HMM Acoustic Model Training by a Two Level Procedure with Gaussian Components Determined by Automatic Model Selection

Automatic detection of tone mispronunciation in mandarin

Noisy Chinese Digit String Speech Recognition Based on Tone Modeling