Abstract:When beginners learn to speak a non-native language, it is difficult for them to judge for themselves whether they are speaking well. Therefore, computer-assisted pronunciation training systems are used to detect learner mispronunciations. These systems typically compare the user's speech with that of a specific native speaker as a model in units of rhythm, phonemes, or words and calculate the differences. However, they require extensive speech data with detailed annotations or can only compare with one specific native speaker. To overcome these problems, we propose a new language learning support system that calculates speech scores and detects mispronunciations by beginners based on a small amount of unannotated speech data without comparison to a specific person. The proposed system uses deep learning--based speech processing to display the pronunciation score of the learner's speech and the difference/distance between the learner's and a group of models' pronunciation in an intuitively visual manner. Learners can gradually improve their pronunciation by eliminating differences and shortening the distance from the model until they become sufficiently proficient. Furthermore, since the pronunciation score and difference/distance are not calculated compared to specific sentences of a particular model, users are free to study the sentences they wish to study. We also built an application to help non-native speakers learn English and confirmed that it can improve users' speech intelligibility.

An English Pronunciation Training System Based on Speech Comparison Technology

Comparison of Pronunciation Scores in Spoken Language Learning System

PTeacher: a Computer-Aided Personalized Pronunciation Training System with Exaggerated Audio-Visual Corrective Feedback

A Mobile Learning System For Learning Mandarin Pronunciation

An English Pronunciation Evaluation Model Based on Acoustic Phonetics Features

Research on pronunciation scoring technology in language training system

Pronunciation Evaluation Technology Based on Computer Aided Chinese Learning System

DDSupport: Language Learning Support System that Displays Differences and Distances from Model Speech

Evaluation of Benefits from a Computer-Aided Pronunciation Training System for German Learners of Mandarin Chinese

Spoken English Assessment System for Non-Native Speakers Using Acoustic and Prosodic Features.

A English Pronunciation Error Detection and Quality Evaluation Model Based on English Text

Speech recognition sensors and artificial intelligence automatic evaluation application in English oral correction system

Phone-based Pronunciation Quality Assessment Algorithm

The Spoken English Practice System Based on Computer English Speech Recognition Technology

Promoting English Pronunciation via Mobile Devices-Based Automatic Speech Evaluation (ASE) Technology

A Computer-Assisted Tool for Automatically Measuring Non-Native Japanese Oral Proficiency

PHONEME ERRORS AUTOMATIC DETECTION SYSTEM FOR THE PRONUNCIATION OF ENGLISH SENTENCES READING

A Spoken English Teaching System Based on Speech Recognition and Machine Learning

Perceptual Evaluation of Pronunciation Quality for Computer Assisted Language Learning

MACHINE LEARNING-BASED PRONUNCIATION EVALUATION OF SPOKEN ENGLISH DIALOGUES

Audiovisual Synthesis of Exaggerated Speech for Corrective Feedback in Computer-Assisted Pronunciation Training