Abstract:The queries issued to search engines are often ambiguous or multifaceted, which requires search engines to return diverse results that can fulfill as many different information needs as possible; this is called search result diversification. Recently, the relational learning to rank model, which designs a learnable ranking function following the criterion of maximal marginal relevance, has shown effectiveness in search result diversification [Zhu et al. 2014]. The goodness of a diverse ranking model is usually evaluated with diversity evaluation measures such as α-NDCG [Clarke et al. 2008], ERR-IA [Chapelle et al. 2009], and D&num;-NDCG [Sakai and Song 2011]. Ideally the learning algorithm would train a ranking model that could directly optimize the diversity evaluation measures with respect to the training data. Existing relational learning to rank algorithms, however, only train the ranking models by optimizing loss functions that loosely relate to the evaluation measures. To deal with the problem, we propose a general framework for learning relational ranking models via directly optimizing any diversity evaluation measure. In learning, the loss function upper-bounding the basic loss function defined on a diverse ranking measure is minimized. We can derive new diverse ranking algorithms under the framework, and several diverse ranking algorithms are created based on different upper bounds over the basic loss function. We conducted comparisons between the proposed algorithms with conventional diverse ranking methods using the TREC benchmark datasets. Experimental results show that the algorithms derived under the diverse learning to rank framework always significantly outperform the state-of-the-art baselines.

Redundancy Removal to Selectively Diversify Information Retrieval Results.

ICRCS at Intent2: Applying Rough Set and Semantic Relevance for Subtopic Mining.

Directly Optimize Diversity Evaluation Measures: A New Approach to Search Result Diversification.

Opposite Re-Ranking Based on Relevant Sub-Topic Dispelling

A Subtopic Taxonomy-Aware Framework for Diversity Evaluation.

Summary Of The Ntcir-10 Intent-2 Task: Subtopic Mining And Search Result Diversification

A Document Relevance Based Search Result Re-Ranking

Diversifying the image retrieval results.

Recency Ranking by Diversification of Result Set

Structural Learning of Diverse Ranking.

A New Method for Redundancy Analysis in Feature Selection

Beyond Greedy Search: Pruned Exhaustive Search for Diversified Result Ranking.

THUIR at NTCIR-10 INTENT-2 Task

A Novel Relational Learning-To-Rank Approach For Topic-Focused Multi-Document Summarization

Enhancing the Ranking Context of Dense Retrieval Methods through Reciprocal Nearest Neighbors

Feature Selection with Integrated Relevance and Redundancy Optimization

Efficient Diversification of Web Search Results

Pseudo-Relevance Feedback Based On Mrmr Criteria

A Preference-oriented Diversity Model Based on Mutual-information in Re-ranking for E-commerce Search

Social Image Retrieval Based on Topic Diversity

Affinity rank: a new scheme for efficient web search.