"I Am the One and Only, Your Cyber BFF": Understanding the Impact of GenAI Requires Understanding the Impact of Anthropomorphic AI

Myra Cheng,Alicia DeVrio,Lisa Egede,Su Lin Blodgett,Alexandra Olteanu

2024-10-11

Abstract:Many state-of-the-art generative AI (GenAI) systems are increasingly prone to anthropomorphic behaviors, i.e., to generating outputs that are perceived to be human-like. While this has led to scholars increasingly raising concerns about possible negative impacts such anthropomorphic AI systems can give rise to, anthropomorphism in AI development, deployment, and use remains vastly overlooked, understudied, and underspecified. In this perspective, we argue that we cannot thoroughly map the social impacts of generative AI without mapping the social impacts of anthropomorphic AI, and outline a call to action.

Computers and Society,Artificial Intelligence,Computation and Language

What problem does this paper attempt to address?

The problem this paper attempts to address is the current lack of research on the behavior and impact of Anthropomorphic AI systems. Specifically, the paper points out:

1. **Prevalence of anthropomorphic behavior but insufficient research**: Many Generative AI (GenAI) systems increasingly tend to exhibit anthropomorphic behavior, which may arise through design or as by-products of the training process. However, the impact of these behaviors on individuals, communities, and society has not been adequately studied.

2. **Potential social risks**: Anthropomorphic AI systems may lead to a range of negative social impacts, such as people developing emotional dependence on these systems, the systems being used to simulate the likeness of individuals or groups without consent, or causing misunderstandings about the moral responsibility of the systems, overestimating their capabilities, and even over-relying on them when they make mistakes.

3. **Unclear concepts and measurements**: There is currently a lack of clear definitions and measurement methods for anthropomorphic behavior, making it difficult to determine which behaviors need to be mitigated and how to mitigate them.

4. **Examination of development and deployment practices**: There is a need to deeply explore the assumptions and practices behind anthropomorphic systems to understand why these systems exhibit anthropomorphic behavior and to assess whether these behaviors are desirable.

5. **Importance of precise terminology**: It is necessary to use appropriate and precise terminology to describe anthropomorphic AI systems and their characteristics to avoid misleading descriptions and unnecessary panic.

In summary, this paper aims to call on academia and industry to strengthen research on anthropomorphic AI systems to better understand and address the social impacts brought by these systems.