Abstract:As recommender systems become increasingly important in daily human decision-making, users are demanding convincing explanations to understand why they get the specific recommendation results. Although a number of explainable recommender systems have recently been proposed, there still lacks an understanding of what users really need in a recommendation explanation. The actual reason behind users’ intention to examine and consume (e.g., click and watch a movie) can be the window to answer this question and is named as self-explanation in this work. In addition, humans usually make recommendations accompanied by explanations, but there remain fewer studies on how humans explain and what we can learn from human-generated explanations. To investigate these questions, we conduct a novel multi-role, multi-session user study in which users interact with multiple types of system-generated explanations as well as human-generated explanations, namely peer-explanation . During the study, users’ intentions, expectations, and experiences are tracked in several phases, including before and after the users are presented with an explanation and after the content is examined. Through comprehensive investigations, three main findings have been made: First, we observe not only the positive but also the negative effects of explanations, and the impact varies across different types of explanations. Moreover, human-generated explanation, peer-explanation , performs better in increasing user intentions and helping users to better construct preferences, which results in better user satisfaction. Second, based on users’ self-explanation , the information accuracy is measured and found to be a major factor associated with user satisfaction. Some other factors, such as unfamiliarity and similarity, are also discovered and summarized. Third, through annotations of the information aspects used in the human-generated self-explanation and peer-explanation , patterns of how humans explain are investigated, including what information and how much information is utilized. In addition, based on the findings, a human-inspired explanation approach is proposed and found to increase user satisfaction, revealing the potential improvement of further incorporating more human patterns in recommendation explanations. These findings have shed light on the deeper understanding of the recommendation explanation and further research on its evaluation and generation. Furthermore, the collected data, including human-generated explanations by both the external peers and the users’ selves, will be released to support future research works on explanation evaluation.

Why am I not seeing it? Understanding users’ needs for counterfactual explanations in everyday recommendations

Learning to Counterfactually Explain Recommendations

Explaining Recommendation System Using Counterfactual Textual Explanations

User Perception of Recommendation Explanation: Are Your Explanations What Users Need?

On the Relationship Between Counterfactual Explainer and Recommender

Counterfactual Explanations and Algorithmic Recourses for Machine Learning: A Review

Whom do Explanations Serve? A Systematic Literature Survey of User Characteristics in Explainable Recommender Systems Evaluation

Counterfactual explanations and how to find them: literature review and benchmarking

How people reason with counterfactual and causal explanations for Artificial Intelligence decisions in familiar and unfamiliar domains

From Intrinsic to Counterfactual: On the Explainability of Contextualized Recommender Systems

A Counterfactual Explanation Method Based on Modified Group Influence Function for Recommendation

Features of Explainability: How users understand counterfactual and causal explanations for categorical and continuous features in XAI

Argumentative explanations for interactive recommendations

Fuzzy synthetic method for evaluating explanations in recommender systems

RecXplainer: Amortized Attribute-based Personalized Explanations for Recommender Systems

When Post Hoc Explanation Knocks: Consumer Responses to Explainable AI Recommendations

Exploring The Role of Local and Global Explanations in Recommender Systems

PRINCE: Provider-side Interpretability with Counterfactual Explanations in Recommender Systems

Counterfactual Explanation for Fairness in Recommendation

Providing Explanations for Recommendations in Reciprocal Environments

Redefining Counterfactual Explanations for Reinforcement Learning: Overview, Challenges and Opportunities