Abstract:State-of-the-art industrial-level recommender system applications mostly adopt complicated model structures such as deep neural networks. While this helps with the model performance, the lack of system explainability caused by these nearly blackbox models also raises concerns and potentially weakens the users’ trust on the system. Existing work on explainable recommendation mostly focuses on designing interpretable model structures to generate model-intrinsic explanations. However, most of them have complex structures and it is difficult to directly apply these designs onto existing recommendation applications due to the effectiveness and efficiency concerns. On the other hand, while there have been some studies on explaining recommendation models without knowing their internal structures (i.e. model-agnostic explanations), these methods have been criticized for not reflecting the actual reasoning process of the recommendation model, or in other words, not faithful . How to develop model-agnostic explanation methods and evaluate them in terms of faithfulness is mostly unknown. In this work, we propose a reusable evaluation pipeline for model-agnostic explainable recommendation. Our pipeline evaluates the quality of model-agnostic explanation from the perspectives of faithfulness and scrutability. We further propose a model-agnostic explanation framework for recommendation and verify it with the proposed evaluation pipeline. Extensive experiments on public datasets demonstrate that our model-agnostic framework is able to generate explanations that are faithful to the recommendation model. We additionally provide quantitative and qualitative study to show that our explanation framework could enhance the scrutability of blackbox recommendation model. With proper modification, our evaluation pipeline and model-agnostic explanation framework could be easily migrated to existing applications. Through this work, we hope to encourage the community to focus more on faithfulness evaluation of explainable recommender systems.

A Model-Agnostic Recommendation Explanation System Based on Knowledge Graph

Explainable Recommendation Using Review Text and a Knowledge Graph

Knowledge Enhanced Graph Neural Networks for Explainable Recommendation

A Reusable Model-agnostic Framework for Faithfully Explainable Recommendation and System Scrutability

Knowledge-grounded Natural Language Recommendation Explanation

Explicable recommendation model based on a time‐assisted knowledge graph and many‐objective optimization algorithm

Faithfully Explainable Recommendation via Neural Logic Reasoning

Explainable Entity-based Recommendations with Knowledge Graphs

Jointly Learning Explainable Rules for Recommendation with Knowledge Graph

A Joint Framework for Explainable Recommendation with Knowledge Reasoning and Graph Representation

Post Processing Recommender Systems with Knowledge Graphs for Recency, Popularity, and Diversity of Explanations

Ekar: an Explainable Method for Knowledge Aware Recommendation

Review of Explainable Graph-Based Recommender Systems

Explainable Reasoning over Knowledge Graphs for Recommendation

Multi-modal Recommendation Based on Knowledge Graph

Knowledge-aware Autoencoders for Explainable Recommender Sytems

Social-Enhanced Explainable Recommendation With Knowledge Graph

Neural-Symbolic Reasoning over Knowledge Graph for Multi-stage Explainable Recommendation

An Efficient Recommendation Model Based on Knowledge Graph Attention-Assisted Network (KGATAX)

Fairness-Aware Explainable Recommendation over Knowledge Graphs

Multi-contrastive Learning Recommendation Combined with Knowledge Graph