Abstract:In this study, we applied a combination of speech-to-text recognition (STR) and computer-aided translation (CAT) technologies during lectures in English as a foreign language to facilitate student comprehension of the lecture content. The instructor lectured in English, the STR system generated texts from the voice input, and the CAT system then simultaneously translated the STR texts into the students' native language. We aimed to test the feasibility of applying combined STR and CAT technologies to facilitate student comprehension of lecture content in a foreign language. To this end, we designed an experiment. Three groups with twenty students each were formed. All students attended the same lectures: (a) students in the control group attended lectures without any support, (b) students in experimental group 1 attended lectures with STR support (i.e., they were presented with texts in English generated from the instructor's speech by STR), and (c) students in experimental group 2 attended lectures with STR and CAT support (i.e., they were presented with texts in their native language that were translated from English by STR and CAT). We compared the posttest results of the students in the three groups. We also explored the effects of our approach with respect to different levels of foreign language ability. Finally, we surveyed the perceptions of students in experimental group 2 about the usefulness of the translated texts for their learning. Our results showed that applying STR and CAT technologies together was a useful approach: the translated texts helped significantly improve student learning performance compared to that of the students in the control condition. Translated texts were beneficial for students, as the students were able (a) to confirm some words that were not clearly spoken by the instructor or to find the meaning of some words with which the students were not familiar and (b) to complement spoken lecture content with translated content to help information processing and enhance comprehension. When comparing students with different language abilities, we found that students with low language abilities benefited from the translated texts the most. The students' language ability was significantly lower than that of the high-ability students before the experiment; however, the low-ability students' learning performance showed no significant difference from the high-ability students after the experiment. Finally, most students perceived translated texts as useful for their learning, and they intended to use the texts in the future for learning purposes.

Using texts generated by STR and CAT to facilitate student comprehension of lecture content in a foreign language

Applications of speech-to-text recognition and computer-aided translation for facilitating cross-cultural learning through a learning activity: issues and their solutions

Investigating the effectiveness of speech-to-text recognition applications on learning performance, attention, and meditation

Speech-to-text recognition in University English as a Foreign Language Learning

Using a Game-Based Translation Learning App and Google Apps to Enhance Translation Skills: Amplification and Omission

A study of college students' perceptions of utilizing automatic speech recognition technology to assist English oral proficiency

Effectiveness of SmartCat Technology in Artistic, Scientific-Technical and Social-Publicist Translations: How Modern Software Influence the Specificity of Different Types of Translation

A review of research on computer‐aided translation technologies and their applications to assist learning and instruction

The impact of CS structured computer-assisted translation system on English linguistics teaching in universities

Developing Translation Competence of Undergraduate Translation Students under Computer-aided Translation Technology

Exploring the Influence of CAT Tools on Domestication and Foreignization in Translation

THINK-ALOUD PROTOCOLS, EYE-TRACKING AND KEY-LOGGING IN IDENTIFICATION AND ADDRESSING TRANSLATION CHALLENGES

COMPUTER-ASSISTED TRANSLATION THEORY AND PRACTICE AS AN EFFECTIVE TOOL IN TEACHING ELSP TO STUDENTS OF TECHNICAL UNIVERSITIES

Multimedia Interaction-Based Computer-Aided Translation Technology in Applied English Teaching

Research on CAT-based Interactive Collaboration Mode of Undergraduate Translation Course

Learning With Mobile Augmented Reality- and Automatic Speech Recognition-Based Materials for English Listening and Speaking Skills: Effectiveness and Perceptions of Non-English Major English as a Foreign Language Students

The Effects of Visual Input and Text Types on the Listening Comprehension of EFL Students in China

The Effects of Using Video Texts Supported with Advance Organizers and Captions on Chinese College Students' Listening Comprehension: An Empirical Study

Information Technologies and Language: The Impact of CAT Systems on Improving the Efficiency of Translators' Training

Effect of Multimodal Teaching on Language Comprehensive Ability under the Background of Artificial Intelligence

Integrating Automatic Speech Recognition Technology Into Vocabulary Learning in a Flipped English Class for Chinese College Students