Abstract:In many AI applications today, the predominance of black-box machine learning models, due to their typically higher accuracy, amplifies the need for Explainable AI (XAI). Existing XAI approaches, such as the widely used SHAP values or counterfactual (CF) explanations, are arguably often too technical for users to understand and act upon. To enhance comprehension of explanations of AI decisions and the overall user experience, we introduce XAIstories, which leverage Large Language Models to provide narratives about how AI predictions are made: SHAPstories do so based on SHAP explanations, while CFstories do so for CF explanations. We study the impact of our approach on users' experience and understanding of AI predictions. Our results are striking: over 90% of the surveyed general audience finds the narratives generated by SHAPstories convincing. Data scientists primarily see the value of SHAPstories in communicating explanations to a general audience, with 83% of data scientists indicating they are likely to use SHAPstories for this purpose. In an image classification setting, CFstories are considered more or equally convincing as the users' own crafted stories by more than 75% of the participants. CFstories additionally bring a tenfold speed gain in creating a narrative. We also find that SHAPstories help users to more accurately summarize and understand AI decisions, in a credit scoring setting we test, correctly answering comprehension questions significantly more often than they do when only SHAP values are provided. The results thereby suggest that XAIstories may significantly help explaining and understanding AI predictions, ultimately supporting better decision-making in various applications.

From Data Stories to Dialogues: A Randomised Controlled Trial of Generative AI Agents and Data Storytelling in Enhancing Data Visualisation Comprehension

Data Storytelling in Data Visualisation: Does it Enhance the Efficiency and Effectiveness of Information Retrieval and Insights Comprehension?

"It's like a rubber duck that talks back": Understanding Generative AI-Assisted Data Analysis Workflows through a Participatory Prompting Study

Chatting with a Learning Analytics Dashboard: The Role of Generative AI Literacy on Learner Interaction with Conventional and Scaffolding Chatbots

DataNarrative: Automated Data-Driven Storytelling with Visualizations and Texts

Gamifying XAI: Enhancing AI Explainability for Non-technical Users through LLM-Powered Narrative Gamifications

StoryDiffusion: How to Support UX Storyboarding With Generative-AI

Telling creative stories using generative visual aids

Why is ai not a panacea for data workers? an interview study on human-ai collaboration in data storytelling

From Data to Story: Towards Automatic Animated Data Video Creation with LLM-based Multi-Agent Systems

SARD: A Human-AI Collaborative Story Generation

Where are we so far? understanding data storytelling tools from the perspective of human-ai collaboration

StoryCraft AI: Exploring Generative Approaches to Story Narration through AI

Towards a Generative AI Design Dialogue

Tell Me a Story! Narrative-Driven XAI with Large Language Models

Generative AI as a Tool or Leader? Exploring AI-Augmented Thinking in Student Programming Tasks

"I Recall the Past": Exploring How People Collaborate with Generative AI to Create Cultural Heritage Narratives

Benefits and Challenges of Collaboration between Students and Conversational Generative Artificial Intelligence in Programming Learning: An Empirical Case Study