Fears about AI-mediated communication are grounded in different expectations for one's own versus others' use

Zoe A. Purcell,Mengchen Dong,Anne-Marie Nussberger,Nils Köbis,Maurice Jakesch
2023-05-02
Abstract:The rapid development of AI-mediated communication technologies (AICTs), which are digital tools that use AI to augment interpersonal messages, has raised concerns about the future of interpersonal trust and prompted discussions about disclosure and uptake. This paper contributes to this discussion by assessing perceptions about the acceptability and use of open and secret AICTs for oneself and others. In two studies with representative samples (UK: N=477, US: N=765), we found that secret AICT use is deemed less acceptable than open AICT use, people tend to overestimate others' AICT use, and people expect others to use AICTs irresponsibly. Thus, we raise concerns about the potential for misperceptions and different expectations for others to drive self-fulfilling pessimistic outlooks about AI-mediated communication.
Human-Computer Interaction,Artificial Intelligence,Computers and Society
What problem does this paper attempt to address?
The paper attempts to address issues regarding the acceptance and usage expectations of Artificial Intelligence Mediated Communication Technologies (AICTs) in interpersonal communication. Specifically, the researchers explored the following questions: 1. **Secret Use vs. Open Use**: Do people find the secret use of AICTs (i.e., not informing the recipient of the AI's involvement) more unacceptable than the open use of AICTs (i.e., informing the recipient of the AI's involvement)? 2. **Self vs. Others' Usage Expectations**: Do people believe that others will use AICTs more frequently, while they themselves will use them less? 3. **Responsibility Expectations for Others' Use**: Do people think that others will use AICTs irresponsibly? Through two empirical studies, the researchers investigated these hypotheses and examined the impact of two key factors—transparency (open vs. secret use) and user (self vs. others)—on the acceptance and usage expectations of AICTs. The findings indicate that people have a negative attitude towards the secret use of AICTs, believe that others will use these technologies more, and think that others' usage will be more irresponsible. These findings reveal a pessimistic view of AICTs development and how this perception might influence future technological advancements and policy-making.