Abstract:In this study, we applied a combination of speech-to-text recognition (STR) and computer-aided translation (CAT) technologies during lectures in English as a foreign language to facilitate student comprehension of the lecture content. The instructor lectured in English, the STR system generated texts from the voice input, and the CAT system then simultaneously translated the STR texts into the students' native language. We aimed to test the feasibility of applying combined STR and CAT technologies to facilitate student comprehension of lecture content in a foreign language. To this end, we designed an experiment. Three groups with twenty students each were formed. All students attended the same lectures: (a) students in the control group attended lectures without any support, (b) students in experimental group 1 attended lectures with STR support (i.e., they were presented with texts in English generated from the instructor's speech by STR), and (c) students in experimental group 2 attended lectures with STR and CAT support (i.e., they were presented with texts in their native language that were translated from English by STR and CAT). We compared the posttest results of the students in the three groups. We also explored the effects of our approach with respect to different levels of foreign language ability. Finally, we surveyed the perceptions of students in experimental group 2 about the usefulness of the translated texts for their learning. Our results showed that applying STR and CAT technologies together was a useful approach: the translated texts helped significantly improve student learning performance compared to that of the students in the control condition. Translated texts were beneficial for students, as the students were able (a) to confirm some words that were not clearly spoken by the instructor or to find the meaning of some words with which the students were not familiar and (b) to complement spoken lecture content with translated content to help information processing and enhance comprehension. When comparing students with different language abilities, we found that students with low language abilities benefited from the translated texts the most. The students' language ability was significantly lower than that of the high-ability students before the experiment; however, the low-ability students' learning performance showed no significant difference from the high-ability students after the experiment. Finally, most students perceived translated texts as useful for their learning, and they intended to use the texts in the future for learning purposes.

Speech-to-text recognition in University English as a Foreign Language Learning

A study of college students' perceptions of utilizing automatic speech recognition technology to assist English oral proficiency

Implementing an AI-driven System and a LINE Bot to Enhance EFL University Students’ Oral Skills

The impact of automatic speech recognition technology on second language pronunciation and speaking skills of EFL learners: a mixed methods investigation

Learning With Mobile Augmented Reality- and Automatic Speech Recognition-Based Materials for English Listening and Speaking Skills: Effectiveness and Perceptions of Non-English Major English as a Foreign Language Students

Applications of speech-to-text recognition and computer-aided translation for facilitating cross-cultural learning through a learning activity: issues and their solutions

Integrating Automatic Speech Recognition Technology Into Vocabulary Learning in a Flipped English Class for Chinese College Students

Using a Game-Based Translation Learning App and Google Apps to Enhance Translation Skills: Amplification and Omission

Investigating the effectiveness of speech-to-text recognition applications on learning performance, attention, and meditation

An Examination of Automatic Speech Recognition (ASR)-based Computer-assisted Pronunciation Training (CAPT) for Less-proficient EFL Students Using the Technology Acceptance Model

The Effects of Employing My ET on College Students’ Pronunciation Skills Training in Taiwan

ASR-based system for promoting pronunciation

Using texts generated by STR and CAT to facilitate student comprehension of lecture content in a foreign language

Applying role-playing strategy to enhance learners’ writing and speaking skills in EFL courses using Facebook and Skype as learning tools: a case study in Taiwan

Students' Attitudes Toward the Use of Edtech as a Powerful Pronunciation Learning Tool in EFL

Effects of reciprocal peer feedback on EFL learners’ communication strategy use and oral communication performance

An evaluative study of a mobile application for middle school students struggling with English vocabulary learning

Collaborative Kinesthetic English Learning With Recognition Technology

Using Repeated- Reading and Listening –While- Reading via Text-To- Speech APPs. in Developing Fluency and Comprehension

Study of Artificial Intelligence-Assisted English Oral Teaching

Application of Speech Recognition Technology in Pronunciation Correction of College Oral English Teaching