Abstract:Introduction: In the context of the burgeoning field of second language (L2) education, where proficient writing plays an integral role in effective language acquisition and communication, the ever-increasing technology development has influenced the trajectory of L2 writing development. Methods: To address the need for enhanced writing skills among English as a Foreign Language (EFL) learners, this study investigates the efficacy of Automated Writing Evaluation (AWE) training. A randomized controlled trial employing repeated measures was conducted, involving a participant pool of 190 Chinese EFL students. The study comprehensively assessed the effects of AWE training, utilizing the Grammarly platform—an AI-driven program—on various dimensions of writing skills, encompassing task achievement, coherence and cohesion, lexicon, and grammatical accuracy. Control variables included writing self-efficacy and global English proficiency. Writing skills were evaluated through the administration of an International English Language Testing System (IELTS) writing sample test. Results: The results unequivocally demonstrate that the experimental group consistently exhibited superior performance across all facets of writing skills compared to the control group. Furthermore, the predictive influence of pre-test scores was pronounced in task achievement, coherence and cohesion, and lexicon, highlighting the pivotal role of learners' initial proficiency levels in shaping subsequent writing outcomes. Notably, the emergence of writing self-efficacy as a significant predictor of task achievement and coherence and cohesion underscores the role of learners' beliefs and confidence in shaping their writing abilities. Discussion: These findings conclusively suggest that Artificial Intelligence-based instructional programs, specifically AWE, hold the potential to effectively enhance second language writing skills, especially among learners with lower proficiency levels. This study carries crucial implications for EFL educators and researchers, advocating for the seamless integration of AWE into pedagogical strategies to foster a marked improvement in writing competence.

Automated Writing Evaluation in Language Teaching: Theory, Development, and Application

Comparative Study about the Impacts of Chinese Automated Writing Evaluation (AWE) Feedback and Teacher Feedback on Middle School Students’ Writing Practice

Using Automated Writing Evaluation in Classroom Assessment: A Critical Review

A Critical Interpretative Synthesis: The Integration of Automated Writing Evaluation into Classroom Writing Instruction

Empowering Second Language Writing Instruction with Automated Writing Evaluation

The role of automated writing evaluation holistic scores in the ESL classroom

Automated feedback and writing: a multi-level meta-analysis of effects on students' performance

Impact of automated writing evaluation on teacher feedback, student revision, and writing improvement

The impact of automated writing evaluation on second language writing skills of Chinese EFL learners: a randomized controlled trial

Using the Developmental Path of Cause to Bridge the Gap Between Awe Scores and Writing Teachers' Evaluations

Neural Automated Writing Evaluation with Corrective Feedback

From process to product: writing engagement and performance of EFL learners under computer-generated feedback instruction

The effectiveness of automated writing evaluation in EFL/ESL writing: a three-level meta-analysis

Voluntary use of automated writing evaluation by content course students

A Latent Dirichlet Allocation approach to understanding students' perceptions of Automated Writing Evaluation

Impact of AWE Rubrics and Automated Assessment on EFL Writing Instruction

E MERGING T ECHNOLOGIES Partnering with AI: Intelligent writing assistance and instructed language learning

The Impact of Automated Evaluation Feedback on Students’ Writing Revision

Computer or human: a comparative study of automated evaluation scoring and instructors’ feedback on Chinese college students’ English writing

Automated writing evaluation (AWE) feedback: a systematic investigation of college students’ acceptance

Understanding AWE Feedback and English Writing of Learners with Different Proficiency Levels in an EFL Classroom: A Sociocultural Perspective