Abstract:ABSTRACTQueries describe the users' search intent and therefore they play an essential role in the context of ranking for information retrieval and Web search. However, most of existing approaches for ranking do not explicitly take into consideration the fact that queries vary significantly along several dimensions and entail different treatments regarding the ranking models. In this paper, we propose to incorporate query difference into ranking by introducing query-dependent loss functions. In the context of Web search, query difference is usually represented as different query categories; and, queries are usually classified according to search intent such as navigational, informational and transactional queries. Based on the observation that such kind of query categorization has high correlation with the user's different expectation on the result accuracy on different rank positions, we develop position-sensitive query-dependent loss functions exploring such kind of query categorization. Beyond the simple learning method that builds ranking functions with pre-defined query categorization, we further propose a new method that learns both ranking functions and query categorization simultaneously. We apply the query-dependent loss functions to two particular ranking algorithms, RankNet and ListMLE. Experimental results demonstrate that query-dependent loss functions can be exploited to significantly improve the accuracy of learned ranking functions. We also show that the ranking function jointly learned with query categorization can achieve better performance than that learned with pre-defined query categorization. Finally, we provide analysis and conduct additional experiments to gain deeper understanding on the advantages of ranking with query-dependent loss functions over other query-dependent ranking approaches and query-independent approaches.

Query-level stability and generalization in learning to rank

Two-Layer Generalization Analysis for Ranking Using Rademacher Average.

Generalization Analysis of Listwise Learning-to-rank Algorithms

Generalization Bounds for Stochastic Gradient Langevin Dynamics: A Unified View Via Information Leakage Analysis

Generalization Error Bounds for Optimization Algorithms Via Stability

Generalization Analysis For Ranking

Query-level loss functions for information retrieval

Bounds on the Generalization Error in Active Learning

Robust Generalization and Safe Query-Specialization in Counterfactual Learning to Rank

Uniform Convergence, Stability and Learnability for Ranking Problems.

Exponential Generalization Bounds with Near-Optimal Rates for $L_q$-Stable Algorithms.

Stability Analysis and Learning Bounds for Transductive Regression Algorithms

Learning to rank relational objects and its application to web search.

Stability revisited: new generalisation bounds for the Leave-one-Out

Stability and Multigroup Fairness in Ranking with Uncertain Predictions

Ranking with query-dependent loss for web search.

On the Tightness of Information-Theoretic Bounds on Generalization Error of Learning Algorithms.

Learning to Search Web Pages with Query-Level Loss Functions

An Information-Theoretic Analysis for Transfer Learning: Error Bounds and Applications

Stability and Generalization for Stochastic Recursive Momentum-based Algorithms for (Strongly-)Convex One to $K$-Level Stochastic Optimizations