Abstract:ABSTRACTQueries describe the users' search intent and therefore they play an essential role in the context of ranking for information retrieval and Web search. However, most of existing approaches for ranking do not explicitly take into consideration the fact that queries vary significantly along several dimensions and entail different treatments regarding the ranking models. In this paper, we propose to incorporate query difference into ranking by introducing query-dependent loss functions. In the context of Web search, query difference is usually represented as different query categories; and, queries are usually classified according to search intent such as navigational, informational and transactional queries. Based on the observation that such kind of query categorization has high correlation with the user's different expectation on the result accuracy on different rank positions, we develop position-sensitive query-dependent loss functions exploring such kind of query categorization. Beyond the simple learning method that builds ranking functions with pre-defined query categorization, we further propose a new method that learns both ranking functions and query categorization simultaneously. We apply the query-dependent loss functions to two particular ranking algorithms, RankNet and ListMLE. Experimental results demonstrate that query-dependent loss functions can be exploited to significantly improve the accuracy of learned ranking functions. We also show that the ranking function jointly learned with query categorization can achieve better performance than that learned with pre-defined query categorization. Finally, we provide analysis and conduct additional experiments to gain deeper understanding on the advantages of ranking with query-dependent loss functions over other query-dependent ranking approaches and query-independent approaches.

Query-Dependent Ranking

Ranking with query-dependent loss for web search.

Query Dependent Ranking Using K-nearest Neighbor.

Query-level Loss Functions for Information Retrieval

Instance-Ranking: A New Perspective to Consider the Instance Dependency for Classification

Learning to Search Web Pages with Query-Level Loss Functions

Query Clustering Based on Query Requirements for Ranking

Query-dependent cross-domain ranking in heterogeneous network

Understanding and Improving Neural Ranking Models from a Term Dependence View.

Query clustering for learning to rank models on web search

Beyond Probability Ranking Principle: Modeling the Dependencies among Documents

Multi-Query Parallel Field Ranking for image retrieval.

The Surprising Effectiveness of Rankers Trained on Expanded Queries

Contextual Ranking of Database Querying Results: A Statistical Approach

Learning Query-Dependent Distance Metrics for Interactive Image Retrieval

Query Processing on Uncertain Data

Online Learning of Optimally Diverse Rankings

A Unified Approach to Ranking in Probabilistic Databases

Ranking with Adaptive Neighbors

On the Feasibility and Robustness of Pointwise Evaluation of Query Performance Prediction