QVoice: Arabic Speech Pronunciation Learning Application

Yassine El Kheir,Fouad Khnaisser,Shammur Absar Chowdhury,Hamdy Mubarak,Shazia Afzal,Ahmed Ali

2023-05-09

Abstract:This paper introduces a novel Arabic pronunciation learning application QVoice, powered with end-to-end mispronunciation detection and feedback generator module. The application is designed to support non-native Arabic speakers in enhancing their pronunciation skills, while also helping native speakers mitigate any potential influence from regional dialects on their Modern Standard Arabic (MSA) pronunciation. QVoice employs various learning cues to aid learners in comprehending meaning, drawing connections with their existing knowledge of English language, and offers detailed feedback for pronunciation correction, along with contextual examples showcasing word usage. The learning cues featured in QVoice encompass a wide range of meaningful information, such as visualizations of phrases/words and their translations, as well as phonetic transcriptions and transliterations. QVoice provides pronunciation feedback at the character level and assesses performance at the word level.

Audio and Speech Processing,Computation and Language,Sound

What problem does this paper attempt to address?

The paper introduces an application called QVoice, which aims to address the issues faced by non-native Arabic speakers in learning Standard Arabic pronunciation and help native speakers reduce the influence of regional dialects on their Modern Standard Arabic (MSA) pronunciation. Specifically, the QVoice application attempts to solve the following key problems:

1. **Providing a personalized and autonomous learning experience**: Traditional language learning methods often require a significant amount of time and resources in a classroom environment. QVoice leverages technology to offer learners a more personalized and self-paced learning experience.

2. **Supporting pronunciation training**: For children, extensive practice is needed to develop reading and pronunciation skills; for non-native learners, there are challenges due to differences between their native language and the target language; and for native speakers, regional dialects may influence their pronunciation. QVoice provides a comprehensive tool for these learners to improve their Arabic pronunciation accuracy.

3. **Implementing automated pronunciation assessment and feedback**: The application embeds an end-to-end mispronunciation detection model that can evaluate learners' pronunciation in real-time and provide detailed feedback, including identifying insertions, deletions, substitutions, and pronunciation errors. Additionally, the model can detect pronunciation issues caused by dialectal influences.

In summary, the main purpose of the QVoice application is to improve the pronunciation skills of Arabic learners by offering a series of learning tips and detailed pronunciation correction feedback, helping users enhance their Arabic pronunciation level.