Abstract:In many AI applications today, the predominance of black-box machine learning models, due to their typically higher accuracy, amplifies the need for Explainable AI (XAI). Existing XAI approaches, such as the widely used SHAP values or counterfactual (CF) explanations, are arguably often too technical for users to understand and act upon. To enhance comprehension of explanations of AI decisions and the overall user experience, we introduce XAIstories, which leverage Large Language Models to provide narratives about how AI predictions are made: SHAPstories do so based on SHAP explanations, while CFstories do so for CF explanations. We study the impact of our approach on users' experience and understanding of AI predictions. Our results are striking: over 90% of the surveyed general audience finds the narratives generated by SHAPstories convincing. Data scientists primarily see the value of SHAPstories in communicating explanations to a general audience, with 83% of data scientists indicating they are likely to use SHAPstories for this purpose. In an image classification setting, CFstories are considered more or equally convincing as the users' own crafted stories by more than 75% of the participants. CFstories additionally bring a tenfold speed gain in creating a narrative. We also find that SHAPstories help users to more accurately summarize and understand AI decisions, in a credit scoring setting we test, correctly answering comprehension questions significantly more often than they do when only SHAP values are provided. The results thereby suggest that XAIstories may significantly help explaining and understanding AI predictions, ultimately supporting better decision-making in various applications.

A cookbook of translating English to Xapi

Xapagy: a cognitive architecture for narrative reasoning

From Black Boxes to Conversations: Incorporating XAI in a Conversational Agent

Tell Me a Story! Narrative-Driven XAI with Large Language Models

Shadows and Headless Shadows: an Autobiographical Approach to Narrative Reasoning

AN INTERMEDIATE LANGUAGE X-CODE

Explainable AI (XAI): Core Ideas, Techniques, and Solutions

ConvXAI: Delivering Heterogeneous AI Explanations via Conversations to Support Human-AI Scientific Writing

Explanation–Question–Response dialogue: An argumentative tool for explainable AI

Demystifying XAI: Requirements for Understandable XAI Explanations

Towards Feasible Counterfactual Explanations: A Taxonomy Guided Template-based NLG Method

Towards Symbolic XAI -- Explanation Through Human Understandable Logical Relationships Between Features

Gamifying XAI: Enhancing AI Explainability for Non-technical Users through LLM-Powered Narrative Gamifications

Making SHAP Rap: Bridging Local and Global Insights Through Interaction and Narratives

AI Readiness in Healthcare through Storytelling XAI

Extracting human interpretable structure-property relationships in chemistry using XAI and large language models

Explainability in JupyterLab and Beyond: Interactive XAI Systems for Integrated and Collaborative Workflows

Axe the X in XAI: A Plea for Understandable AI

Shadows and headless shadows: a worlds-based, autobiographical approach to reasoning

Effective Representation to Capture Collaboration Behaviors between Explainer and User

Explingo: Explaining AI Predictions using Large Language Models