Abstract:The issue of fairness in recommendation is becoming increasingly essential as Recommender Systems touch and influence more and more people in their daily lives. In fairness-aware recommendation, most of the existing algorithmic approaches mainly aim at solving a constrained optimization problem by imposing a constraint on the level of fairness while optimizing the main recommendation objective, e.g., CTR. While this alleviates the impact of unfair recommendations, the expected return of an approach may significantly compromise the recommendation accuracy due to the inherent trade-off between fairness and utility. This motivates us to deal with these conflicting objectives and explore the optimal trade-off between them in recommendation. One conspicuous approach is to seek a Pareto efficient solution to guarantee optimal compromises between utility and fairness. Moreover, considering the needs of real-world e-commerce platforms, it would be more desirable if we can generalize the whole Pareto Frontier, so that the decision-makers can specify any preference of one objective over another based on their current business needs. Therefore, in this work, we propose a fairness-aware recommendation framework using multi-objective reinforcement learning, called MoFIR, which is able to learn a single parametric representation for optimal recommendation policies over the space of all possible preferences. Specially, we modify traditional DDPG by introducing conditioned network into it, which conditions the networks directly on these preferences and outputs Q-value-vectors. Experiments on several real-world recommendation datasets verify the superiority of our framework on both fairness metrics and recommendation measures when compared with all other baselines. We also extract the approximate Pareto Frontier on real-world datasets generated by MoFIR and compare to state-of-the-art fairness methods.

Value-aware recommendation based on reinforcement profit maximization

Value-aware Recommendation based on Reinforced Profit Maximization in E-commerce Systems

Show Me the Money: Dynamic Recommendations for Revenue Maximization

Model-based approaches to profit-aware recommendation

Optimizing Long-term Value for Auction-Based Recommender Systems via On-Policy Reinforcement Learning

Maximizing profit using recommender systems

Optimizing Ranking Algorithm in Recommender System Via Deep Reinforcement Learning

Reinforcement Learning to Optimize Lifetime Value in Cold-Start Recommendation

Exploring Customer Price Preference and Product Profit Role in Recommender Systems

RevMan: Revenue-aware Multi-task Online Insurance Recommendation

Balancing consumer and business value of recommender systems: A simulation-based analysis

Jointly Learning to Recommend and Advertise

Long-run User Value Optimization in Recommender Systems through Content Creation Modeling

From Clicks to Conversions: Recommendation for long-term reward

Collaborative Competitive filtering II: Optimal Recommendation and Collaborative Games

A Hybrid Probabilistic Multiobjective Evolutionary Algorithm for Commercial Recommendation Systems

A Deep Reinforcement Learning Real-Time Recommendation Model Based on Long and Short-Term Preference

Toward Pareto Efficient Fairness-Utility Trade-off inRecommendation through Reinforcement Learning

Learning Personalized Risk Preferences for Recommendation

Optimizing Enhanced Cost Per Click Via Reinforcement Learning Without Exploration

Maximizing Cumulative User Engagement in Sequential Recommendation: An Online Optimization Perspective