Abstract:The queries issued to search engines are often ambiguous or multifaceted, which requires search engines to return diverse results that can fulfill as many different information needs as possible; this is called search result diversification. Recently, the relational learning to rank model, which designs a learnable ranking function following the criterion of maximal marginal relevance, has shown effectiveness in search result diversification [Zhu et al. 2014]. The goodness of a diverse ranking model is usually evaluated with diversity evaluation measures such as α-NDCG [Clarke et al. 2008], ERR-IA [Chapelle et al. 2009], and D&num;-NDCG [Sakai and Song 2011]. Ideally the learning algorithm would train a ranking model that could directly optimize the diversity evaluation measures with respect to the training data. Existing relational learning to rank algorithms, however, only train the ranking models by optimizing loss functions that loosely relate to the evaluation measures. To deal with the problem, we propose a general framework for learning relational ranking models via directly optimizing any diversity evaluation measure. In learning, the loss function upper-bounding the basic loss function defined on a diverse ranking measure is minimized. We can derive new diverse ranking algorithms under the framework, and several diverse ranking algorithms are created based on different upper bounds over the basic loss function. We conducted comparisons between the proposed algorithms with conventional diverse ranking methods using the TREC benchmark datasets. Experimental results show that the algorithms derived under the diverse learning to rank framework always significantly outperform the state-of-the-art baselines.

A Survey on Search Result Diversification

A Survey of Query Result Diversification

Multi-dimensional Search Result Diversification

Result Diversification in Search and Recommendation: A Survey

A Learning Approach to Hierarchical Search Result Diversification.

Search Result Diversification for Enterprise Data

Search Result Diversification Based on Query Facets

Building a Test Collection for Evaluating Search Result Diversity: A Preliminary Study

Search Result Diversification Based on Hierarchical Intents.

Knowledge Enhanced Search Result Diversification

Supervised Search Result Diversification Via Subtopic Attention

Search Result Diversity Evaluation Based on Intent Hierarchies.

Efficient Diversification of Web Search Results

Directly Optimize Diversity Evaluation Measures: A New Approach to Search Result Diversification.

Diversifying Product Search Results

A Learnable Search Result Diversification Method

Leveraging Integrated Information to Extract Query Subtopics for Search Result Diversification

Result Diversification in Event-Based Social Networks.

Integrated Personalized and Diversified Search Based on Search Logs

Modeling Intent Graph for Search Result Diversification

Passage-aware Search Result Diversification