Abstract:Dynamic Learning-to-Rank (DLTR) is a method of updating a ranking policy in real-time based on user feedback, which may not always be accurate. Although previous DLTR work has achieved fair and unbiased DLTR under inaccurate feedback, they face the trade-off between fairness and user utility and also have limitations in the setting of feeding items. Existing DLTR works improve ranking utility by eliminating bias from inaccurate feedback on observed items, but the impact of another pervasive form of inaccurate feedback, overlooked or ignored interesting items, remains unclear. For example, users may browse the rankings too quickly to catch interesting items or miss interesting items because the snippets are not optimized enough. This phenomenon raises two questions: i) Will overlooked interesting items affect the ranking results? ii) Is it possible to improve utility without sacrificing fairness if these effects are eliminated? These questions are particularly relevant for small and medium-sized retailers who are just starting out and may have limited data, leading to the use of inaccurate feedback to update their models. In this paper, we find that inaccurate feedback in the form of overlooked interesting items has a negative impact on DLTR performance in terms of utility. To address this, we treat the overlooked interesting items as noise and propose a novel DLTR method, the Co-teaching Rank (CoTeR), that has good utility and fairness performance when inaccurate feedback is present in the form of overlooked interesting items. Our solution incorporates a co-teaching-based component with a customized loss function and data sampling strategy, as well as a mean pooling strategy to further accommodate newly added products without historical data. Through experiments, we demonstrate that CoTeRx not only enhances utilities but also preserves ranking fairness, and can smoothly handle newly introduced items.

Predicting E-Book Ranking Based on the Implicit User Feedback

Click-Through Rate Prediction Algorithm Based on Modeling of Implicit High-Order Feature Importance

A Novel Confidence Estimation Method for Heterogeneous Implicit Feedback

Brand Recommendation Leveraging Heterogeneous Implicit Feedbacks

RSS Item Ranking Based on Implicit Feedback

Understanding the Ranking Loss for Recommendation with Sparse User Feedback

Do Not Wait: Learning Re-Ranking Model Without User Feedback At Serving Time in E-Commerce

CTR is not Enough: a Novel Reinforcement Learning based Ranking Approach for Optimizing Session Clicks

Prediction Uncertainty in Collaborative Filtering: Enhancing Personalized Online Product Ranking.

Modeling Users' Contextualized Page-wise Feedback for Click-Through Rate Prediction in E-commerce Search

Mitigating Exploitation Bias in Learning to Rank with an Uncertainty-aware Empirical Bayes Approach

Debiasing the Conversion Rate Prediction Model in the Presence of Delayed Implicit Feedback

Learned Ranking Function: From Short-term Behavior Predictions to Long-term User Satisfaction

Learning-to-Rank with Nested Feedback

Click-through conversion rate prediction model of book e-commerce platform based on feature combination and representation

A TDF-WNSP-WLFM algorithm for product recommendation based on multiple types of implicit user behavior

Learning Personalized Page Content Ranking Using Customer Representation

A Reputation Ranking Method Based on Rating Patterns and Rating Deviation

Mitigating the Impact of Inaccurate Feedback in Dynamic Learning-to-Rank: A Study of Overlooked Interesting Items

Reinforcement Learning to Rank in E-Commerce Search Engine: Formalization, Analysis, and Application

E-Commerce Big Data Analysis and User Behavior Prediction Algorithm Based on Deep Learning