Abstract:State-of-the-art industrial-level recommender system applications mostly adopt complicated model structures such as deep neural networks. While this helps with the model performance, the lack of system explainability caused by these nearly blackbox models also raises concerns and potentially weakens the users’ trust on the system. Existing work on explainable recommendation mostly focuses on designing interpretable model structures to generate model-intrinsic explanations. However, most of them have complex structures and it is difficult to directly apply these designs onto existing recommendation applications due to the effectiveness and efficiency concerns. On the other hand, while there have been some studies on explaining recommendation models without knowing their internal structures (i.e. model-agnostic explanations), these methods have been criticized for not reflecting the actual reasoning process of the recommendation model, or in other words, not faithful . How to develop model-agnostic explanation methods and evaluate them in terms of faithfulness is mostly unknown. In this work, we propose a reusable evaluation pipeline for model-agnostic explainable recommendation. Our pipeline evaluates the quality of model-agnostic explanation from the perspectives of faithfulness and scrutability. We further propose a model-agnostic explanation framework for recommendation and verify it with the proposed evaluation pipeline. Extensive experiments on public datasets demonstrate that our model-agnostic framework is able to generate explanations that are faithful to the recommendation model. We additionally provide quantitative and qualitative study to show that our explanation framework could enhance the scrutability of blackbox recommendation model. With proper modification, our evaluation pipeline and model-agnostic explanation framework could be easily migrated to existing applications. Through this work, we hope to encourage the community to focus more on faithfulness evaluation of explainable recommender systems.

Scratch‐RL: A preference‐driven adversarial reinforcement reasoning framework over knowledge graphs for explainable recommendation of Scratch

Scratch-Rec: a novel Scratch recommendation approach adapting user preference and programming skill for enhancing learning to program

A Reinforcement Learning Framework for Explainable Recommendation

ScratchGAN: Network representation learning for scratch with preference‐based generative adversarial nets

Reinforcement Knowledge Graph Reasoning for Explainable Recommendation

A Joint Framework for Explainable Recommendation with Knowledge Reasoning and Graph Representation

Multi-modal Knowledge-aware Reinforcement Learning Network for Explainable Recommendation

KERL: A Knowledge-Guided Reinforcement Learning Model for Sequential Recommendation

Multi-level Recommendation Reasoning over Knowledge Graphs with Reinforcement Learning

Knowledge-aware Reasoning with Self-Supervised Reinforcement Learning for Explainable Recommendation in MOOCs

A Survey on Explainable Reinforcement Learning: Concepts, Algorithms, Challenges

Explainable Session-based Recommendation via Path Reasoning

Self-Supervised Reinforcement Learning with dual-reward for knowledge-aware recommendation

Privileged Knowledge State Distillation for Reinforcement Learning-based Educational Path Recommendation

Teach and Explore: A Multiplex Information-guided Effective and Efficient Reinforcement Learning for Sequential Recommendation

A Reusable Model-agnostic Framework for Faithfully Explainable Recommendation and System Scrutability

Explainable Recommendation with Personalized Review Retrieval and Aspect Learning

CADRL: Category-aware Dual-agent Reinforcement Learning for Explainable Recommendations over Knowledge Graphs

Advantage Actor-Critic with Reasoner: Explaining the Agent's Behavior from an Exploratory Perspective.

Learning to Rank Rationales for Explainable Recommendation

AdaRec: Adaptive Sequential Recommendation for Reinforcing Long-term User Engagement