Abstract:Introduction: In the context of the burgeoning field of second language (L2) education, where proficient writing plays an integral role in effective language acquisition and communication, the ever-increasing technology development has influenced the trajectory of L2 writing development. Methods: To address the need for enhanced writing skills among English as a Foreign Language (EFL) learners, this study investigates the efficacy of Automated Writing Evaluation (AWE) training. A randomized controlled trial employing repeated measures was conducted, involving a participant pool of 190 Chinese EFL students. The study comprehensively assessed the effects of AWE training, utilizing the Grammarly platform—an AI-driven program—on various dimensions of writing skills, encompassing task achievement, coherence and cohesion, lexicon, and grammatical accuracy. Control variables included writing self-efficacy and global English proficiency. Writing skills were evaluated through the administration of an International English Language Testing System (IELTS) writing sample test. Results: The results unequivocally demonstrate that the experimental group consistently exhibited superior performance across all facets of writing skills compared to the control group. Furthermore, the predictive influence of pre-test scores was pronounced in task achievement, coherence and cohesion, and lexicon, highlighting the pivotal role of learners' initial proficiency levels in shaping subsequent writing outcomes. Notably, the emergence of writing self-efficacy as a significant predictor of task achievement and coherence and cohesion underscores the role of learners' beliefs and confidence in shaping their writing abilities. Discussion: These findings conclusively suggest that Artificial Intelligence-based instructional programs, specifically AWE, hold the potential to effectively enhance second language writing skills, especially among learners with lower proficiency levels. This study carries crucial implications for EFL educators and researchers, advocating for the seamless integration of AWE into pedagogical strategies to foster a marked improvement in writing competence.

Perceptions and attitudes of English learners towards the utilization of AI-based Automated Writing Evaluation (AWE) programs and instructor feedback

Comparative Study about the Impacts of Chinese Automated Writing Evaluation (AWE) Feedback and Teacher Feedback on Middle School Students’ Writing Practice

A Correlation Study of Automated Writing Evaluation System (Grammarly) and Chinese EFL Learners’ Writing Self-Efficacy in Their Self-Regulated Learning

Student perceptions of Grammarly, teacher’s indirect and direct feedback: Possibility of machine feedback

Use of AI-based Platforms in Teaching and Learning of General English Writing for College EFL Learners

Learner Uptake with Automated Feedback and Teacher Feedback in an Online EFL Writing Context

"Grammarly" as English Writing Assistant from EFL Students’ Perspective

University students’ perceptions of artificial intelligence-based tools for English writing courses

Exploring the effects of Grammarly on EFL students’ foreign language anxiety and learner autonomyGilbert Dizon

The impact of automated writing evaluation on second language writing skills of Chinese EFL learners: a randomized controlled trial

Potential Impact of Automated Writing Evaluation (AWE) on EFL Learners’ Writing Accuracy: Learners’ Attitudes in Focus

From process to product: writing engagement and performance of EFL learners under computer-generated feedback instruction

Impact of automated writing evaluation on teacher feedback, student revision, and writing improvement

Understanding AWE Feedback and English Writing of Learners with Different Proficiency Levels in an EFL Classroom: A Sociocultural Perspective

Learner interaction with, and response to, AI-programmed automated writing evaluation feedback in EFL writing: An exploratory study

Leveraging the potential of ChatGPT as an automated writing evaluation (AWE) tool: Students' feedback literacy development and AWE tools integration framework

Automated Writing Evaluation: the Accuracy of Grammarly's Feedback on Form

Investigating EFL students’ linguistic problems using Grammarly as automated writing evaluation feedback

AI-generated feedback on writing: insights into efficacy and ENL student preference

The effectiveness of automated writing evaluation in EFL/ESL writing: a three-level meta-analysis

Automated writing evaluation tools for Indonesian undergraduate English as a foreign language students’ writing