Abstract:Objectives This article aims to validate the efficacy of AI-adaptive learning (AI-AL) in college English courses. It achieves this aim by examining the influence of AI-AL on learner's academic achievements in TOEIC and self-perception of self-directed learning abilities. This investigation involves analyzing TOEIC exam outcomes, encompassing key English education components like listening, grammar, vocabulary, and reading. Methods We computed descriptive statistics using SPSS 25.0 and performed a paired t-test on the pre- and post- exam results of an online mock TOEIC for 61 students enrolled in Sections A and B of AI English 2 at H University. To explore the change in learners’ self-perception of their academic achievements and improved self-directed learning skills, we examined 56 selected reflective journals. Additionally, we conducted two rounds of expert Delphi assessments to validate the content. Results First, the analysis of the online exams showed a modest increase of 5.246 points in the average score of the listening comprehension section, although no statistically significant difference was observed. Secondly, the average score of the reading comprehension section exhibited a significant increase of 12.459 points, indicat-ing a statistically notable difference. Thirdly, upon analyzing students' reflective journals using factors employed to assess self-directed learning ability, it was found that “desire to learn” had the highest frequency (96.4%). This was followed by “self-reflection” (91.1%), “attributing results to their efforts” (66.1%), “persistence in learning” (62.5%), “goal setting” (48.2%), “self-management” (46.4%), “identifying learning resources” (35.7%), and “selecting learning strategies” (30.4%). Conclusions This study demonstrates that AI-AL positively influences learners’ proficiency in TOEIC RC and self-perception of self-directed learning abilities. This research is particularly relevant in today's era of hy-per-connectivity and personalized learning, as it substantiates the potential of AI-AL in catering to individual lear-ners' needs and learning pace, while offering practical solutions to enhance its effectiveness. The results of this research are expected to be useful as foundational materials for colleges looking to integrate AI-AL programs into their curriculum.

The predictive validity of IELTS scores: a meta-analysis

The influence of English language proficiency test scores on the academic success of ESL undergraduate students

Examining the predictive validity of the Duolingo English Test: Evidence from a major UK university

The Interpretation and Use of Proficiency Test Scores in University Selection: How Valid and Ethical Are They?

Predictive validities: figures of merit or veils of deception?

Test-taker self-assessment accuracy using the TOEIC speaking and writing can-do statements

The Effect of English Admission Test and Various Variables on Foreign Language Skills of Students

The Impact of AI-Adaptive Learning on TOEIC Academic Achievement and Self-Directed Learning Competency in College English Classes

A Comparative-Correlative Study of Test Rubrics Used as Benchmarks in Assessing IELTS and TOEFL Speaking Skills

Information literacy self-efficacy versus performance: Secondary students

Interpreting the effectiveness of academic English writing programmes in higher education: A meta-analysis

What Factors Most Impact on Chinese Students’ Performance in the IELTS Academic Reading Sub-Test?

Assessing the Impact of English Language Skills and TOEIC Performance on Career Development

The affectability of writing assessment scores: a G-theory analysis of rater, task, and scoring method contribution

DOES SELF-ESTEEM INFLUENCE STUDENT ENGLISH PROFICIENCY TEST SCORES?

Emotional intelligence and second/foreign language achievement: A meta-analytic review

THE CORRELATION BETWEEN STUDENTS' SELF-ESTEEM AND THEIR ENGLISH PROFICIENCY TEST RESULT

The Effect of a National Education Policy on Language Test Performance: a Fairness Perspective

Comparing TOEFL and teacher’s assessment scores in measuring student’s English skills

Emotional intelligence predicts academic performance: A meta-analysis.

Relationships of International Students’ L2 Vocabulary, Receptive Skills, and Strategy Use: A Pathway College Context