AI-Assisted Writing in Education: Ecosystem Risks and Mitigations

Antonette Shibani,Simon Buckingham Shum

2024-05-14

Abstract:While the excitement around the capabilities of technological advancements is giving rise to new AI-based writing assistants, the overarching ecosystem plays a crucial role in how they are adopted in educational practice. In this paper, we point to key ecological aspects for consideration. We draw insights from extensive research integrated with practice on a writing feedback tool over 9 years at a university, and we highlight potential risks when these are overlooked. It informs the design of educational writing support tools to be better aligned within broader contexts to balance innovation with practical impact.

Human-Computer Interaction,Artificial Intelligence

What problem does this paper attempt to address?

The paper primarily explores the application of AI-Assisted Writing tools in the field of education and the potential risks and mitigation measures within their ecosystem. Specifically, the authors point out that although advancements in AI technology have brought new writing assistance tools, the successful application of these tools in educational practice depends not only on the technology itself but also on the socio-technical ecosystem in which they are embedded. Through years of research and practical experience, the paper emphasizes the need to consider broader ecological factors in the design process to ensure these tools can better integrate into actual teaching environments, thereby balancing technological innovation with practical effectiveness.

The core of the paper lies in identifying and analyzing the key dimensions of the AI writing assistance tools ecosystem, including digital infrastructure, access patterns, social factors, regional characteristics, norms and rules, and time-varying factors. For each dimension, the paper proposes corresponding mitigation strategies for potential risks. Additionally, the paper introduces the specific case of AcaWriter, demonstrating how long-term collaboration and improvement can transform an AI writing tool from a research prototype into a product widely used in higher education classrooms. Through these analyses, the paper aims to provide valuable references and insights for future designers of AI writing assistance tools.