Abstract:Deep learning-based recommender systems (DRSs) are increasingly and widely deployed in the industry, which brings significant convenience to people’s daily life in different ways. However, recommender systems are also shown to suffer from multiple issues, e.g., the echo chamber and the Matthew effect , of which the notation of “fairness” plays a core role. For instance, the system may be regarded as unfair to 1) a specific user, if the user gets worse recommendations than other users, or 2) an item (to recommend), if the item is much less likely to be exposed to the users than other items. While many fairness notations and corresponding fairness testing approaches have been developed for traditional deep classification models, they are essentially hardly applicable to DRSs. One major challenge is that there still lacks a systematic understanding and mapping between the existing fairness notations and the diverse testing requirements for deep recommender systems, not to mention further testing or debugging activities. To address the gap, we propose FairRec, a unified framework that supports fairness testing of DRSs from multiple customized perspectives, e.g., model utility, item diversity, item popularity, etc. We also propose a novel, efficient search-based testing approach to tackle the new challenge, i.e., double-ended discrete particle swarm optimization (DPSO) algorithm, to effectively search for hidden fairness issues in the form of certain disadvantaged groups from a vast number of candidate groups. Given the testing report, by adopting a simple re-ranking mitigation strategy on these identified disadvantaged groups, we show that the fairness of DRSs can be significantly improved. We conducted extensive experiments on multiple industry-level DRSs adopted by leading companies. The results confirm that FairRec is effective and efficient in identifying the deeply hidden fairness issues, e.g., achieving ∼95% testing accuracy with ∼half to 1/8 time.

Optimizing Ranking Algorithm in Recommender System Via Deep Reinforcement Learning

FairRec: Fairness Testing for Deep Recommender Systems

Optimizing Sponsored Search Ranking Strategy by Deep Reinforcement Learning

CTR is not Enough: a Novel Reinforcement Learning based Ranking Approach for Optimizing Session Clicks

Exploiting Structural and Temporal Influence for Dynamic Social-Aware Recommendation

Optimized Recommender Systems with Deep Reinforcement Learning

Reinforcement Learning to Rank in E-Commerce Search Engine: Formalization, Analysis, and Application

Ada-Ranker

A Practical Deep Online Ranking System In E-Commerce Recommendation

Deep Policy Optimization for E-commerce Sponsored Search Ranking Strategy

Deep Reinforcement Learning for List-wise Recommendations

Top-aware reinforcement learning based recommendation

DEAR: Deep Reinforcement Learning for Online Advertising Impression in Recommender Systems

A Combinatorial Recommendation System Framework Based on Deep Reinforcement Learning.

A Deep Reinforcement Learning Real-Time Recommendation Model Based on Long and Short-Term Preference

Optimizing Long-term Value for Auction-Based Recommender Systems via On-Policy Reinforcement Learning

Reinforcement Learning to Optimize Long-term User Engagement in Recommender Systems

Ada-Ranker: A Data Distribution Adaptive Ranking Paradigm for Sequential Recommendation

Stabilizing Reinforcement Learning in Dynamic Environment with Application to Online Recommendation

Deep Pareto Reinforcement Learning for Multi-Objective Recommender Systems

Reciprocal Ranking: A Hybrid Ranking Algorithm For Reciprocal Recommendation