Abstract:Search result diversification aims at covering different user intents by returning a diversified document list. Most existing diversity measures require a predefined set of intents for a given query, where it is assumed that there is no relationship across these intents. However, studies have shown that modeling a hierarchy of intents has some benefits over the standard measure of using a flat list of intents. Intuitively, having more layers in the intent hierarchy seems to imply that we can consider more intricate relationships between intents and thereby identify subtle differences between documents that cover different intents. On the other hand, manually building a rich intent hierarchy imposes extra cost and is probably not very practical. In light of these considerations, we first propose a measure to build a hierarchy of intents from a given set of flat intents by clustering per-intent relevant documents and thereby identifying subintents. Furthermore, in our second measure, we consider a variant of our first measure that clusters per-topic relevance documents rather than per-intent ones, which is also intent-free. In addition, we propose our third measure, a simple, completely intent-free measure to search result diversity evaluation, which leverages document similarities. Our experiments based on TREC Web Track 2009–2013 test collections show that our proposed measures have advantages over existing diversity measures despite their low annotation costs.

The Search Result Diversification Approach Based on the HITS Algorithm

Multi-dimensional Search Result Diversification

Efficient Diversification of Web Search Results

A Survey on Search Result Diversification

A Subtopic Taxonomy-Aware Framework for Diversity Evaluation.

Search Result Diversification Based on Query Facets

Search Result Diversity Evaluation Based on Intent Hierarchies.

Search Result Diversification Based on Hierarchical Intents.

Beyond Greedy Search: Pruned Exhaustive Search for Diversified Result Ranking.

A Learning Approach to Hierarchical Search Result Diversification.

Passage-aware Search Result Diversification

Research and Optimization of HITS Based on Theory of Diffusion in Web Mining

Search Results Diversification Based on Swap Minimal Marginal Contribution.

Evaluating Search Result Diversity Using Intent Hierarchies.

Improving Diversity in Web Search Results Re-Ranking Using Absorbing Random Walks

Low-cost, Bottom-Up Measures for Evaluating Search Result Diversification

A Survey of Query Result Diversification

Supervised Search Result Diversification Via Subtopic Attention

Building a Test Collection for Evaluating Search Result Diversity: A Preliminary Study

Knowledge Enhanced Search Result Diversification

Search Result Diversification via Filling Up Multiple Knapsacks.