Abstract:Objectives This article aims to validate the efficacy of AI-adaptive learning (AI-AL) in college English courses. It achieves this aim by examining the influence of AI-AL on learner's academic achievements in TOEIC and self-perception of self-directed learning abilities. This investigation involves analyzing TOEIC exam outcomes, encompassing key English education components like listening, grammar, vocabulary, and reading. Methods We computed descriptive statistics using SPSS 25.0 and performed a paired t-test on the pre- and post- exam results of an online mock TOEIC for 61 students enrolled in Sections A and B of AI English 2 at H University. To explore the change in learners’ self-perception of their academic achievements and improved self-directed learning skills, we examined 56 selected reflective journals. Additionally, we conducted two rounds of expert Delphi assessments to validate the content. Results First, the analysis of the online exams showed a modest increase of 5.246 points in the average score of the listening comprehension section, although no statistically significant difference was observed. Secondly, the average score of the reading comprehension section exhibited a significant increase of 12.459 points, indicat-ing a statistically notable difference. Thirdly, upon analyzing students' reflective journals using factors employed to assess self-directed learning ability, it was found that “desire to learn” had the highest frequency (96.4%). This was followed by “self-reflection” (91.1%), “attributing results to their efforts” (66.1%), “persistence in learning” (62.5%), “goal setting” (48.2%), “self-management” (46.4%), “identifying learning resources” (35.7%), and “selecting learning strategies” (30.4%). Conclusions This study demonstrates that AI-AL positively influences learners’ proficiency in TOEIC RC and self-perception of self-directed learning abilities. This research is particularly relevant in today's era of hy-per-connectivity and personalized learning, as it substantiates the potential of AI-AL in catering to individual lear-ners' needs and learning pace, while offering practical solutions to enhance its effectiveness. The results of this research are expected to be useful as foundational materials for colleges looking to integrate AI-AL programs into their curriculum.

Examining the predictive validity of the Duolingo English Test: Evidence from a major UK university

Predictability of Duolingo English Mock Test for Chinese College-Level EFLs: Using Assessment Use Argument

Speaking performances, stakeholder perceptions, and test scores: Extrapolating from the Duolingo English test to the university

Examining the subjective fairness of at-home and online tests: Taking Duolingo English Test as an example

The predictive validity of IELTS scores: a meta-analysis

The influence of English language proficiency test scores on the academic success of ESL undergraduate students

Towards a Sustainable Multidimensional Approach to English Proficiency Proof in the Post-Pandemic Era: Learning from the Legacy of COVID-19

The Effect of a National Education Policy on Language Test Performance: a Fairness Perspective

Development and Validation of A Computer Adaptive Efl Test

The Interpretation and Use of Proficiency Test Scores in University Selection: How Valid and Ethical Are They?

The Effect of English Admission Test and Various Variables on Foreign Language Skills of Students

Responsible AI for Test Equity and Quality: The Duolingo English Test as a Case Study

Preparing for the Speaking Tasks of the TOEFL iBT® Test: An Investigation of the Journeys of Chinese Test Takers

Fairness of using different English accents: The effect of shared L1s in listening tasks of the Duolingo English test

Comparison of Chinese and Western English language proficiency measures in transnational business degrees

Exploring the relative contributions of learning motivations and test perceptions to autonomous English as a foreign language learning and achievement

Pre-enrollment tests to predict first-year academic achievement in open-admission higher STEM education

The Impact of AI-Adaptive Learning on TOEIC Academic Achievement and Self-Directed Learning Competency in College English Classes

Speech Recognition Technology in Language Testing: Does Taking the Test in an English-Speaking Environment Matter?

Test-takers have a say: understanding the implications of the use of AI in language tests

Longitudinal associations between German and English language competencies in Grade 9 and educational success