Abstract:This report proposes state-of-the-art research in the field of Computer Assisted Language Learning (CALL). Mispronunciation detection is one of the core components of Computer Assisted Pronunciation Training (CAPT) systems which is a subset of CALL. Studies on automated pronunciation error detection began in the 1990s, but the development of fullfledged CAPTs has only accelerated in the last decade due to an increase in computing power and availability of mobile devices for recording speech required for pronunciation analysis. Detecting Pronunciation errors is a hard problem to solve as there is no formal definition of correct and incorrect pronunciation. As a result, typically prosodic and phoneme errors such as phoneme substitution, insertion, and deletion are detected. Also, it has been agreed upon that learning pronunciation should focus on speaker intelligibility rather than sounding like an L1 English speaker. Initially, methods were developed on posterior likelihood called Good of Pronunciation using Gaussian Mixture Model-Hidden Markov Model and Deep Neural Network-Hidden Markov Model approaches. These are complex systems to implement when compared with the recently proposed ASR based End-to-End mispronunciations detection systems. The purpose of this research is to create End-to-End (E2E) models using Connectionist Temporal Classification (CTC) and Attention-based sequence decoder. Recently, E2E models have shown considerable improvement in mispronunciation detection accuracy. This research will draw comparison amongst baseline models CNN-RNN-CTC, CNN-RNN-CTC with character sequence-based attention decoder, and CNN-RNN-CTC with phoneme-based decoder systems. This study will help us in deciding a better approach towards developing an efficient mispronunciation detection system.

Attention-CNN Combined with Multi-Layer Feature Fusion for English L2 Multi-Granularity Pronunciation Assessment

BiCAPT: Bidirectional Computer-Assisted Pronunciation Training with Normalizing Flows

Grading the Severity of Mispronunciations in CAPT Based on Statistical Analysis and Computational Speech Perception

Pronunciation Erroneous Tendency Detection with Combination of Convolutional Neural Network and Long Short-Term Memory

Analysis on Mispronunciations in Capt Based on Computational Speech Perception

A Hierarchical Context-aware Modeling Approach for Multi-aspect and Multi-granular Pronunciation Assessment

Transformer-Based Multi-Aspect Multi-Granularity Non-Native English Speaker Pronunciation Assessment

Effective Acoustic Modeling for Pronunciation Quality Scoring of Strongly Accented Mandarin Speech

Multi-lingual and Multi-Task DNN Learning for Articulatory Error Detection.

Automatic Pronunciation Evaluation Of Non-Native Mandarin Tone By Using Multi-Level Confidence Measures

Multi-Modal Multi-Scale Speech Expression Evaluation In Computer-Assisted Language Learning

Coarse-Grained Attention Fusion with Joint Training Framework for Complex Speech Enhancement and End-to-End Speech Recognition

End-to-End Word-Level Pronunciation Assessment with MASK Pre-training

Towards Robust Mispronunciation Detection and Diagnosis for L2 English Learners with Accent-Modulating Methods

Improved Mispronunciation detection system using a hybrid CTC-ATT based approach for L2 English speakers

Context-aware Goodness of Pronunciation for Computer-Assisted Pronunciation Training

Improve low-resource non-native mispronunciation detection with native speech by articulatory-based tandem feature

Impacts of multicollinearity on CAPT modalities: An heterogeneous machine learning framework for computer-assisted French phoneme pronunciation training

Masked Acoustic Unit for Mispronunciation Detection and Correction

Applying Multitask Learning To Acoustic-Phonemic Model For Mispronunciation Detection And Diagnosis In L2 English Speech

An Application of Modified Confusion Network for Improving Mispronunciation Detection in Computer-aided Mandarin Pronunciation Training