Abstract:Background: Empathy is a driving force in our connection to others, our mental well-being, and resilience to challenges. With the rise of generative artificial intelligence (AI) systems, mental health chatbots, and AI social support companions, it is important to understand how empathy unfolds toward stories from human versus AI narrators and how transparency plays a role in user emotions. Objective: We aim to understand how empathy shifts across human-written versus AI-written stories, and how these findings inform ethical implications and human-centered design of using mental health chatbots as objects of empathy. Methods: We conducted crowd-sourced studies with 985 participants who each wrote a personal story and then rated empathy toward 2 retrieved stories, where one was written by a language model, and another was written by a human. Our studies varied disclosing whether a story was written by a human or an AI system to see how transparent author information affects empathy toward the narrator. We conducted mixed methods analyses: through statistical tests, we compared user's self-reported state empathy toward the stories across different conditions. In addition, we qualitatively coded open-ended feedback about reactions to the stories to understand how and why transparency affects empathy toward human versus AI storytellers. Results: We found that participants significantly empathized with human-written over AI-written stories in almost all conditions, regardless of whether they are aware (t 196 =7.07, P <.001, Cohen d =0.60) or not aware (t 298 =3.46, P <.001, Cohen d =0.24) that an AI system wrote the story. We also found that participants reported greater willingness to empathize with AI-written stories when there was transparency about the story author (t 494 =–5.49, P <.001, Cohen d =0.36). Conclusions: Our work sheds light on how empathy toward AI or human narrators is tied to the way the text is presented, thus informing ethical considerations of empathetic artificial social support or mental health chatbots. Trial Registration:

Robot Vulnerability and the Elicitation of User Empathy

Feeling with a robot-the role of anthropomorphism by design and the tendency to anthropomorphize in human-robot interaction

Increasing Helpfulness towards a Robot by Emotional Adaption to the User

Is It Me or the Robot? A Critical Evaluation of Human Affective State Recognition in a Cognitive Task

Is it possible for people to develop a sense of empathy toward humanoid robots and establish meaningful relationships with them?

Moving away from robotic interactions: Evaluation of empathy, emotion and sentiment expressed and detected by computer systems

The Effect of Trust and its Antecedents on Robot Acceptance

Help, Anyone? A User Study For Modeling Robotic Behavior To Mitigate Malfunctions With The Help Of The User

"Hit the Robot on the Head With This Mallet" - Making a Case for Including More Open Questions in HRI Research

The Effects of Healthcare Robot Empathy Statements and Head Nodding on Trust and Satisfaction: A Video Study

A Mini-survey on Psychological Pillars of Empathy for Social Robots: Self-Awareness, Theory of Mind, and Perspective Taking

User Affect Elicitation with a Socially Emotional Robot

Can empathy affect the attribution of mental states to robots?

The emotional robotic storyteller: On the influence of affect congruency on narrative transportation, robot perception, and persuasion

Empathy Toward Artificial Intelligence Versus Human Experiences and the Role of Transparency in Mental Health and Social Support Chatbot Design: Comparative Study

A Study on the Role of Affective Feedback in Robot-Assisted Learning

Empathy in Human–Robot Interaction: Designing for Social Robots

The Emotional Dilemma: Influence of a Human-like Robot on Trust and Cooperation

Towards the development of an automated robotic storyteller: comparing approaches for emotional story annotation for non-verbal expression via body language

Robots at work: People prefer-and forgive-service robots with perceived feelings

Robots’ “Woohoo” and “Argh” can Enhance Users’ Emotional and Social Perceptions: An Exploratory Study on Non-Lexical Vocalizations and Non-Linguistic Sounds