Exploring the Impact of Artificial Intelligence-Mediated Communication on Bias and Information Loss in Non-academic and Academic Writing Contexts
B. P. Towne
Abstract:Artificial Intelligence-Mediated Communication (AI-MC) is transforming the way messages are constructed, disseminated, and interpreted, with large language models (LLMs) like ChatGPT, Claude, and Gemini increasingly being integrated into various facets of writing, including academic and scientific contexts. While AI-MC has the potential to enhance writing efficiency, overcome language barriers, and foster diversity in text creation, it also raises concerns about bias, information loss, and the overall impact on communication accuracy and integrity. Previous research has highlighted the complex role of AI in mediated communication, its influence on language use, interpersonal dynamics, and the ethical implications of AI integration. However, there is a notable gap in research specifically addressing AI-MC's role in non-academic and academic writing contexts, despite the widespread recognition and application of AI-MC in these domains. Here, we present a dual-study approach to investigate the impact of AI-MC, specifically through LLMs, on positivity bias and information loss in non-academic and academic writing contexts. Our findings reveal that LLMs exhibit varied effects on bias perception, with ChatGPT 4.0 significantly reducing perceived bias in non-academic texts, while Claude 3 Opous and Gemini Advanced show no significant impact or slight enhancement of bias, respectively. Surprisingly, ChatGPT demonstrated the ability to convey emotional intensity more accurately than the original authors. In terms of information loss, no significant differences were found between original and AI-refined texts across both studies. These results contribute to the ongoing discourse on the ethical, cultural, and technological considerations of AI-MC in scholarly communication. They provide empirical support for the policies of mainstream publishers permitting the use of AI for language polishing in academic articles. However, the study also highlights the need for further research to address limitations such as the exclusive focus on Chinese texts and participants, and to explore the implications across different languages and cultural contexts.
Linguistics,Computer Science,Education