Abstract:Background: Empathy is a driving force in our connection to others, our mental well-being, and resilience to challenges. With the rise of generative artificial intelligence (AI) systems, mental health chatbots, and AI social support companions, it is important to understand how empathy unfolds toward stories from human versus AI narrators and how transparency plays a role in user emotions. Objective: We aim to understand how empathy shifts across human-written versus AI-written stories, and how these findings inform ethical implications and human-centered design of using mental health chatbots as objects of empathy. Methods: We conducted crowd-sourced studies with 985 participants who each wrote a personal story and then rated empathy toward 2 retrieved stories, where one was written by a language model, and another was written by a human. Our studies varied disclosing whether a story was written by a human or an AI system to see how transparent author information affects empathy toward the narrator. We conducted mixed methods analyses: through statistical tests, we compared user's self-reported state empathy toward the stories across different conditions. In addition, we qualitatively coded open-ended feedback about reactions to the stories to understand how and why transparency affects empathy toward human versus AI storytellers. Results: We found that participants significantly empathized with human-written over AI-written stories in almost all conditions, regardless of whether they are aware (t 196 =7.07, P <.001, Cohen d =0.60) or not aware (t 298 =3.46, P <.001, Cohen d =0.24) that an AI system wrote the story. We also found that participants reported greater willingness to empathize with AI-written stories when there was transparency about the story author (t 494 =–5.49, P <.001, Cohen d =0.36). Conclusions: Our work sheds light on how empathy toward AI or human narrators is tied to the way the text is presented, thus informing ethical considerations of empathetic artificial social support or mental health chatbots. Trial Registration:

Should Machines Express Sympathy and Empathy? Experiments with a Health Advice Chatbot

Bots with Feelings: Should AI Agents Express Positive Emotion in Customer Service?

Social and Emotional Etiquette of Chatbots: A Qualitative Approach to Understanding User Needs and Expectations

Bots vs. humans: how schema congruity, contingency-based interactivity, and sympathy influence consumer perceptions and patronage intentions

The Illusion of Empathy: How AI Chatbots Shape Conversation Perception

Digital Confessions: The Willingness to Disclose Intimate Information to a Chatbot and its Impact on Emotional Well-Being

Empathy Toward Artificial Intelligence Versus Human Experiences and the Role of Transparency in Mental Health and Social Support Chatbot Design: Comparative Study

Emojifying Chatbot Interactions: an Exploration of Emoji Utilization in Human-Chatbot Communications

AI Chatbot Responds to Emotional Cuing

Moving away from robotic interactions: Evaluation of empathy, emotion and sentiment expressed and detected by computer systems

Risk and prosocial behavioural cues elicit human-like response patterns from AI chatbots

Computer says "No": The Case Against Empathetic Conversational AI

CheerBots: Chatbots toward Empathy and Emotionusing Reinforcement Learning

From Adam Smith to artificial intelligence: an experimental exploration of emotion in humanomics

Does a lack of emotions make chatbots unfit to be psychotherapists?

AI-powered Mental Health Communication: Examining the effects of affection expectations on health behavioral intentions

Empathic Chatbot: Emotional Intelligence for Empathic Chatbot: Emotional Intelligence for Mental Health Well-being

The golden zone of AI’s emotional expression in frontline chatbot service failures

Examining the Effect of Anthropomorphic Design Cues on Healthcare Chatbots Acceptance and Organization-Public Relationships: Trust in a Warm Human Vs. a Competent Machine

Chatbots as social companions: How people perceive consciousness, human likeness, and social health benefits in machines

Human vs. machine-like representation in chatbot mental health counseling: the serial mediation of psychological distance and trust on compliance intention