Abstract:Introduction: In the context of the burgeoning field of second language (L2) education, where proficient writing plays an integral role in effective language acquisition and communication, the ever-increasing technology development has influenced the trajectory of L2 writing development. Methods: To address the need for enhanced writing skills among English as a Foreign Language (EFL) learners, this study investigates the efficacy of Automated Writing Evaluation (AWE) training. A randomized controlled trial employing repeated measures was conducted, involving a participant pool of 190 Chinese EFL students. The study comprehensively assessed the effects of AWE training, utilizing the Grammarly platform—an AI-driven program—on various dimensions of writing skills, encompassing task achievement, coherence and cohesion, lexicon, and grammatical accuracy. Control variables included writing self-efficacy and global English proficiency. Writing skills were evaluated through the administration of an International English Language Testing System (IELTS) writing sample test. Results: The results unequivocally demonstrate that the experimental group consistently exhibited superior performance across all facets of writing skills compared to the control group. Furthermore, the predictive influence of pre-test scores was pronounced in task achievement, coherence and cohesion, and lexicon, highlighting the pivotal role of learners' initial proficiency levels in shaping subsequent writing outcomes. Notably, the emergence of writing self-efficacy as a significant predictor of task achievement and coherence and cohesion underscores the role of learners' beliefs and confidence in shaping their writing abilities. Discussion: These findings conclusively suggest that Artificial Intelligence-based instructional programs, specifically AWE, hold the potential to effectively enhance second language writing skills, especially among learners with lower proficiency levels. This study carries crucial implications for EFL educators and researchers, advocating for the seamless integration of AWE into pedagogical strategies to foster a marked improvement in writing competence.

The design and cognitive validity verification of reading-to-write tasks in L2 Chinese writing assessment

Comparative Study about the Impacts of Chinese Automated Writing Evaluation (AWE) Feedback and Teacher Feedback on Middle School Students’ Writing Practice

Diagnosing Writing Ability Using China’s Standards of English Language Ability: Application of Cognitive Diagnosis Models

What accounts for integrated reading-to-write task scores?

Processes Involved in Chinese and English Writing: A Study of Chinese University Students

Exploring and modeling the reading-writing connection in EFL integrated writing

The impact of automated writing evaluation on second language writing skills of Chinese EFL learners: a randomized controlled trial

A Working Analysis of the Tasks of Teaching and Assessment of Chinese as a Second Language

To Predict L2 Writing Quality Using Lexical Richness Indices: an Investigation of Learners of Chinese As a Foreign Language

Examining the Effects of a Real-Time, Knowledge-Aware Tool for Academic Writing Assessment

Assessing L2 integrated writing self-efficacy: Development and validation of a scale

Development and Validation of A Computer Adaptive Efl Test

Self-Regulated Writing Strategy Use When Revising Upon Automated, Peer, and Teacher Feedback in an Online English as a Foreign Language Writing Course

Towards more valid scoring criteria for integrated reading-writing and listening-writing summary tasks

Investigating L2 Writers’ Metacognitive Awareness about L1-L2 Rhetorical Differences

Reading–writing integrated tasks, comprehensive corrective feedback, and EFL writing development

Influence of Task Complexity on Text Features and Writing Scores: Evidence from College Students in Southern China

The Construct of the Story Continuation Writing Task: Insights From the China’s Standards of English Language Ability

Conceptualizing self-regulated reading-to-write in ESL/EFL writing and investigating its relationships to motivation and writing competence

Exploring Relationships Between L2 Chinese Character Writing and Reading Acquisition From Embodied Cognitive Perspectives: Evidence From HSK Big Data

The Effects of Oral Discussion and Text Chat on L2 Chinese Writing