Abstract:As recommender systems become increasingly important in daily human decision-making, users are demanding convincing explanations to understand why they get the specific recommendation results. Although a number of explainable recommender systems have recently been proposed, there still lacks an understanding of what users really need in a recommendation explanation. The actual reason behind users’ intention to examine and consume (e.g., click and watch a movie) can be the window to answer this question and is named as self-explanation in this work. In addition, humans usually make recommendations accompanied by explanations, but there remain fewer studies on how humans explain and what we can learn from human-generated explanations. To investigate these questions, we conduct a novel multi-role, multi-session user study in which users interact with multiple types of system-generated explanations as well as human-generated explanations, namely peer-explanation . During the study, users’ intentions, expectations, and experiences are tracked in several phases, including before and after the users are presented with an explanation and after the content is examined. Through comprehensive investigations, three main findings have been made: First, we observe not only the positive but also the negative effects of explanations, and the impact varies across different types of explanations. Moreover, human-generated explanation, peer-explanation , performs better in increasing user intentions and helping users to better construct preferences, which results in better user satisfaction. Second, based on users’ self-explanation , the information accuracy is measured and found to be a major factor associated with user satisfaction. Some other factors, such as unfamiliarity and similarity, are also discovered and summarized. Third, through annotations of the information aspects used in the human-generated self-explanation and peer-explanation , patterns of how humans explain are investigated, including what information and how much information is utilized. In addition, based on the findings, a human-inspired explanation approach is proposed and found to increase user satisfaction, revealing the potential improvement of further incorporating more human patterns in recommendation explanations. These findings have shed light on the deeper understanding of the recommendation explanation and further research on its evaluation and generation. Furthermore, the collected data, including human-generated explanations by both the external peers and the users’ selves, will be released to support future research works on explanation evaluation.

Persuasive explanations for path reasoning recommendations

Knowledge is Power, Understanding is Impact: Utility and Beyond Goals, Explanation Quality, and Fairness in Path Reasoning Recommendation

Attention Is Not the Only Choice: Counterfactual Reasoning for Path-Based Explainable Recommendation

Is More Always Better? The Effects of Personal Characteristics and Level of Detail on the Perception of Explanations in a Recommender System

Path-based summary explanations for graph recommenders -- extended version

PRINCE: Provider-side Interpretability with Counterfactual Explanations in Recommender Systems

Reinforcement recommendation reasoning through knowledge graphs for explanation path quality

User Perception of Recommendation Explanation: Are Your Explanations What Users Need?

Who Also Likes It? Generating The Most Persuasive Social Explanations In Recommender Systems

Users’ Responsiveness to Persuasive Techniques in Recommender Systems

Towards Personalized Explanation of Robot Path Planning via User Feedback

Measuring the Impact of Explanation Bias: A Study of Natural Language Justifications for Recommender Systems

Reinforced Path Reasoning for Counterfactual Explainable Recommendation

Finding Paths for Explainable MOOC Recommendation: A Learner Perspective

Beyond Persuasion: Towards Conversational Recommender System with Credible Explanations

Concentrating on the Impact: Consequence-based Explanations in Recommender Systems

Post Processing Recommender Systems with Knowledge Graphs for Recency, Popularity, and Diversity of Explanations

Explaining Recommendation System Using Counterfactual Textual Explanations

Towards Interpretation of Recommender Systems with Sorted Explanation Paths

Less is More: Towards Sustainability-Aware Persuasive Explanations in Recommender Systems

Knowledge-grounded Natural Language Recommendation Explanation