Abstract:Deep learning-based recommender systems (DRSs) are increasingly and widely deployed in the industry, which brings significant convenience to people’s daily life in different ways. However, recommender systems are also shown to suffer from multiple issues, e.g., the echo chamber and the Matthew effect , of which the notation of “fairness” plays a core role. For instance, the system may be regarded as unfair to 1) a specific user, if the user gets worse recommendations than other users, or 2) an item (to recommend), if the item is much less likely to be exposed to the users than other items. While many fairness notations and corresponding fairness testing approaches have been developed for traditional deep classification models, they are essentially hardly applicable to DRSs. One major challenge is that there still lacks a systematic understanding and mapping between the existing fairness notations and the diverse testing requirements for deep recommender systems, not to mention further testing or debugging activities. To address the gap, we propose FairRec, a unified framework that supports fairness testing of DRSs from multiple customized perspectives, e.g., model utility, item diversity, item popularity, etc. We also propose a novel, efficient search-based testing approach to tackle the new challenge, i.e., double-ended discrete particle swarm optimization (DPSO) algorithm, to effectively search for hidden fairness issues in the form of certain disadvantaged groups from a vast number of candidate groups. Given the testing report, by adopting a simple re-ranking mitigation strategy on these identified disadvantaged groups, we show that the fairness of DRSs can be significantly improved. We conducted extensive experiments on multiple industry-level DRSs adopted by leading companies. The results confirm that FairRec is effective and efficient in identifying the deeply hidden fairness issues, e.g., achieving ∼95% testing accuracy with ∼half to 1/8 time.

Full-stage Diversified Recommendation: Large-scale Online Experiments in Short-video Platform

Covering Diversification and Fairness for Better Recommendation (Short Paper).

FairRec: Fairness Testing for Deep Recommender Systems

Graph Exploration Matters: Improving both individual-level and system-level diversity in WeChat Feed Recommender

A Joint Optimization Approach for Personalized Recommendation Diversification.

Beyond Item Dissimilarities: Diversifying by Intent in Recommender Systems

Diversify or Not: Dynamic Diversification for Personalized Recommendation

Representation Online Matters: Practical End-to-End Diversification in Search and Recommender Systems

On Practical Diversified Recommendation with Controllable Category Diversity Framework

A joint optimization approach for personalized recommendation diversification

Diversity-Promoting Deep Reinforcement Learning for Interactive Recommendation

Relieving Popularity Bias in Interactive Recommendation: A Diversity-Novelty-Aware Reinforcement Learning Approach

Interactive Content Diversity and User Exploration in Online Movie Recommenders: A Field Experiment

Real-time Video Recommendation Exploration

Recent Advances in Diversified Recommendation

Contextual Distillation Model for Diversified Recommendation

Improving Accuracy and Diversity in Matching of Recommendation with Diversified Preference Network

Divrec: A Framework For Top-N Recommendation With Diversification In E-Commerce

Personalized Re-ranking for Improving Diversity in Live Recommender Systems

Multi-interest Diversification for End-to-end Sequential Recommendation

Prick the filter bubble: A novel cross domain recommendation model with adaptive diversity regularization