Abstract:While learning to rank (LTR) has been widely used in web search to prioritize most relevant webpages among the retrieved contents subject to the input queries, the traditional LTR models fail to deliver decent performance due to two main reasons: 1) the lack of well-annotated query-webpage pairs with ranking scores to cover search queries of various popularity, and 2) ill-trained models based on a limited number of training samples with poor generalization performance. To improve the performance of LTR models, tremendous efforts have been done from above two aspects, such as enlarging training sets with pseudo-labels of ranking scores by self-training, or refining the features used for LTR through feature extraction and dimension reduction. Though LTR performance has been marginally increased, we still believe these methods could be further improved in the newly-fashioned “interpolating regime”. Specifically, instead of lowering the number of features used for LTR models, our work proposes to transform original data with random Fourier feature, so as to over-parameterize the downstream LTR models (e.g., GBRank or LightGBM) with features in ultra-high dimensionality and achieve superb generalization performance. Furthermore, rather than self-training with pseudo-labels produced by the same LTR model in a “self-tuned” fashion, the proposed method incorporates the diversity of prediction results between the listwise and pointwise LTR models while co-training both models with a cyclic labeling-prediction pipeline in a “ping-pong” manner. We deploy the proposed Co-trained and Over-parameterized LTR system COLTR at Baidu search and evaluate COLTR with a large number of baseline methods. The results show that COLTR could achieve $Delta NDCG_{4}$=3.64%$sim$4.92%, compared to baselines, under various ratios of labeled samples. We also conduct a 7-day A/B Test using the realistic web traffics of Baidu Search, where we can still observe significant performance improvement around $Delta NDCG_{4}$=0.17%$sim$0.92% in real-world applications. COLTR performs consistently both in online and offline experiments.

LT2R: Learning to Online Learning to Rank for Web Search

Reinforcement Online Learning to Rank with Unbiased Reward Shaping

Scalable Exploration for Neural Online Learning to Rank with Perturbed Feedback

Is learning to rank effective for Web search?

Effective and secure federated online learning to rank

A Simple yet Effective Framework for Active Learning to Rank

Practical Strategies of Active Learning to Rank for Web Search

Online Learning to Rank with List-level Feedback for Image Filtering

Reinforcement Learning to Rank in E-Commerce Search Engine: Formalization, Analysis, and Application

AliExpress Learning-To-Rank: Maximizing Online Model Performance without Going Online

Exploration of Unranked Items in Safe Online Learning to Re-Rank

Non-stationary Dueling Bandits for Online Learning to Rank

Online Learning to Rank in a Listwise Approach for Information Retrieval

Adversarial Attacks on Online Learning to Rank with Click Feedback

Towards Off-Policy Reinforcement Learning for Ranking Policies with Human Feedback

Bandit Learning to Rank with Position-Based Click Models: Personalized and Equal Treatments

COLTR : Semi-supervised Learning to Rank with Co-training and Over-parameterization for Web Search

Evaluation of Explore-Exploit Policies in Multi-result Ranking Systems

Online Learning of Optimally Diverse Rankings

Unbiased Learning to Rank: Online or Offline?

RankFormer: Listwise Learning-to-Rank Using Listwide Labels