Abstract:Introduction: In the context of the burgeoning field of second language (L2) education, where proficient writing plays an integral role in effective language acquisition and communication, the ever-increasing technology development has influenced the trajectory of L2 writing development. Methods: To address the need for enhanced writing skills among English as a Foreign Language (EFL) learners, this study investigates the efficacy of Automated Writing Evaluation (AWE) training. A randomized controlled trial employing repeated measures was conducted, involving a participant pool of 190 Chinese EFL students. The study comprehensively assessed the effects of AWE training, utilizing the Grammarly platform—an AI-driven program—on various dimensions of writing skills, encompassing task achievement, coherence and cohesion, lexicon, and grammatical accuracy. Control variables included writing self-efficacy and global English proficiency. Writing skills were evaluated through the administration of an International English Language Testing System (IELTS) writing sample test. Results: The results unequivocally demonstrate that the experimental group consistently exhibited superior performance across all facets of writing skills compared to the control group. Furthermore, the predictive influence of pre-test scores was pronounced in task achievement, coherence and cohesion, and lexicon, highlighting the pivotal role of learners' initial proficiency levels in shaping subsequent writing outcomes. Notably, the emergence of writing self-efficacy as a significant predictor of task achievement and coherence and cohesion underscores the role of learners' beliefs and confidence in shaping their writing abilities. Discussion: These findings conclusively suggest that Artificial Intelligence-based instructional programs, specifically AWE, hold the potential to effectively enhance second language writing skills, especially among learners with lower proficiency levels. This study carries crucial implications for EFL educators and researchers, advocating for the seamless integration of AWE into pedagogical strategies to foster a marked improvement in writing competence.

The role of automated writing evaluation holistic scores in the ESL classroom

Comparative Study about the Impacts of Chinese Automated Writing Evaluation (AWE) Feedback and Teacher Feedback on Middle School Students’ Writing Practice

Using the Developmental Path of Cause to Bridge the Gap Between Awe Scores and Writing Teachers' Evaluations

Automated Writing Evaluation in Language Teaching: Theory, Development, and Application

Voluntary use of automated writing evaluation by content course students

Using Automated Writing Evaluation in Classroom Assessment: A Critical Review

A Critical Interpretative Synthesis: The Integration of Automated Writing Evaluation into Classroom Writing Instruction

Understanding AWE Feedback and English Writing of Learners with Different Proficiency Levels in an EFL Classroom: A Sociocultural Perspective

Impact of automated writing evaluation on teacher feedback, student revision, and writing improvement

Impact of AWE Rubrics and Automated Assessment on EFL Writing Instruction

The impact of automated writing evaluation on second language writing skills of Chinese EFL learners: a randomized controlled trial

Empowering Second Language Writing Instruction with Automated Writing Evaluation

Learner Uptake with Automated Feedback and Teacher Feedback in an Online EFL Writing Context

Connecting Criterion Scores and Classroom Grading Contexts: A Systemic Functional Linguistic Model for Teaching and Assessing Causal Language

The effectiveness of automated writing evaluation in EFL/ESL writing: a three-level meta-analysis

Potential Impact of Automated Writing Evaluation (AWE) on EFL Learners’ Writing Accuracy: Learners’ Attitudes in Focus

Computer or human: a comparative study of automated evaluation scoring and instructors’ feedback on Chinese college students’ English writing

From process to product: writing engagement and performance of EFL learners under computer-generated feedback instruction

An Investigation On Chinese Elementary And Secondary School English Teachers' Perceptions On Awe As Formative Assessment Tools

Automated feedback and writing: a multi-level meta-analysis of effects on students' performance

A Latent Dirichlet Allocation approach to understanding students' perceptions of Automated Writing Evaluation