Abstract:Deep learning-based recommender systems (DRSs) are increasingly and widely deployed in the industry, which brings significant convenience to people’s daily life in different ways. However, recommender systems are also shown to suffer from multiple issues, e.g., the echo chamber and the Matthew effect , of which the notation of “fairness” plays a core role. For instance, the system may be regarded as unfair to 1) a specific user, if the user gets worse recommendations than other users, or 2) an item (to recommend), if the item is much less likely to be exposed to the users than other items. While many fairness notations and corresponding fairness testing approaches have been developed for traditional deep classification models, they are essentially hardly applicable to DRSs. One major challenge is that there still lacks a systematic understanding and mapping between the existing fairness notations and the diverse testing requirements for deep recommender systems, not to mention further testing or debugging activities. To address the gap, we propose FairRec, a unified framework that supports fairness testing of DRSs from multiple customized perspectives, e.g., model utility, item diversity, item popularity, etc. We also propose a novel, efficient search-based testing approach to tackle the new challenge, i.e., double-ended discrete particle swarm optimization (DPSO) algorithm, to effectively search for hidden fairness issues in the form of certain disadvantaged groups from a vast number of candidate groups. Given the testing report, by adopting a simple re-ranking mitigation strategy on these identified disadvantaged groups, we show that the fairness of DRSs can be significantly improved. We conducted extensive experiments on multiple industry-level DRSs adopted by leading companies. The results confirm that FairRec is effective and efficient in identifying the deeply hidden fairness issues, e.g., achieving ∼95% testing accuracy with ∼half to 1/8 time.

Spiral of Silence in Recommender Systems

Spiral of Silence and Its Application in Recommender Systems.

FairRec: Fairness Testing for Deep Recommender Systems

Social Recommendation With Evolutionary Opinion Dynamics

A Novel Social Recommendation Method Fusing User’s Social Status and Homophily Based on Matrix Factorization Techniques

Spiral of Silence in Social Networks: A Data-Driven Approach.

A two-step Recommendation Algorithm via Iterative Local Least Squares

User Interest Dynamics on Personalized Recommendation

Quantitative analysis of Matthew effect and sparsity problem of recommender systems

Social Recommendation with Missing Not at Random Data

A Relaxed Ranking-Based Factor Model for Recommender System from Implicit Feedback.

The Sound of Silence in Social Networks

Noisy but Non-Malicious User Detection in Social Recommender Systems

The Role of Fake Users in Sequential Recommender Systems

Skellam Rank: Fair Learning to Rank Algorithm Based on Poisson Process and Skellam Distribution for Recommender Systems

Revisiting Negative Sampling Vs. Non-sampling in Implicit Recommendation

Multivariate opinion evolution analysis on individual opinion differences: An agent-based model

Recommending to Strategic Users

Break Out of a Pigeonhole: A Unified Framework for Examining Miscalibration, Bias, and Stereotype in Recommender Systems

Modeling mutual feedback between users and recommender systems

Selection Bias Mitigation in Recommender System Using Uninteresting Items Based on Temporal Visibility.