Stability of Explainable Recommendation

Sairamvinay Vijayaraghavan,Prasant Mohapatra

2024-05-03

Abstract:Explainable Recommendation has been gaining attention over the last few years in industry and academia. Explanations provided along with recommendations in a recommender system framework have many uses: particularly reasoning why a suggestion is provided and how well an item aligns with a user's personalized preferences. Hence, explanations can play a huge role in influencing users to purchase products. However, the reliability of the explanations under varying scenarios has not been strictly verified from an empirical perspective. Unreliable explanations can bear strong consequences such as attackers leveraging explanations for manipulating and tempting users to purchase target items that the attackers would want to promote. In this paper, we study the vulnerability of existent feature-oriented explainable recommenders, particularly analyzing their performance under different levels of external noises added into model parameters. We conducted experiments by analyzing three important state-of-the-art (SOTA) explainable recommenders when trained on two widely used e-commerce based recommendation datasets of different scales. We observe that all the explainable models are vulnerable to increased noise levels. Experimental results verify our hypothesis that the ability to explain recommendations does decrease along with increasing noise levels and particularly adversarial noise does contribute to a much stronger decrease. Our study presents an empirical verification on the topic of robust explanations in recommender systems which can be extended to different types of explainable recommenders in RS.

Information Retrieval,Machine Learning

What problem does this paper attempt to address?

The main focus of this paper is the stability problem of interpretable recommender systems. In recommender systems, providing explanations can enhance users' trust in recommendations and help them understand why they receive certain recommendations. However, the authors demonstrate through experiments the vulnerability of existing feature-based interpretable recommender systems to external noise, such as malicious attacks, which can lead to unstable explanations. They found that as the level of noise increases, the explanatory power of recommendations decreases, especially in the presence of adversarial noise, which has a greater impact than random noise.

In the experimental part, the authors selected three state-of-the-art interpretable recommender models (CER, A2CF, and EFM) and trained and analyzed them on two different-scale e-commerce datasets. They simulated two types of noise attacks: random noise and adversarial noise (FGSM). The results showed that all models exhibited a significant decline in their explanatory performance as the noise increased, with adversarial noise causing a more severe decline. Additionally, they discovered that the instability of explanations may be related to the handling of implicit and explicit factors in the models.

The paper also discusses the impact of model architecture on the stability of explanations, highlighting the roles of implicit and explicit factors in recommendation and explanation tasks. As the dataset scale increases, the influence of these factors becomes more significant. Finally, the authors emphasize the necessity of establishing robust explanation methods in recommender systems and propose possible directions for future work, including the development of more robust explanation methods and the study of different types of stability, such as cross-domain generalization stability and security-based stability.