Abstract:ABSTRACTLarge web search engines are facing formidable performance challenges because they have to process thousands of queries per second on tens of billions of documents, within interactive response time. Among many others, Top-k query processing (also called early termination or dynamic pruning) is an important class of optimization techniques that can improve the search efficiency and achieve faster query processing by avoiding the scoring of documents that are unlikely to be in the top results. One recent technique is using Block-Max index. In the Block-Max index, the posting lists are organized as blocks and the maximum score for each block is stored to improve the query efficiency. Although query processing speedup is achieved with Block-Max index, the ranking function for the Top-k results is the term-based approach. It is well known that documents' static scores are also important for a good ranking function. In this paper, we show that the performance of the state-of-the-art algorithms with the Block-Max index is degraded when the static score is added in the ranking function. Then we study efficient techniques for Top-k query processing in the case where a page's static score is given, such as PageRank, in addition to the term-based approach. In particular, we propose a set of new algorithms based on the WAND and MaxScore with Block-Max index using local score, which outperform the existing ones. Then we propose new techniques to estimate a better score upper bound for each block. We also study the search efficiency on different index structures where the document identifiers are assigned by URL sorting or by static document scores. Experiments on TREC GOV2 and ClueWeb09B show that considerable performance gains are achieved.

An Efficient Algorithm Based on Covering Codes about Ranking the Results of Partial-Sum Queries

An Efficient Algorithm To Rank The Partial-Sum Queries Results

Binary Code Reranking Method Based on Bit Importance

Ranking Answering in Social Networks

Ranking Z-numbers with an improved ranking method for generalized fuzzy numbers.

Partial Sums-Based P-Rank Computation in Information Networks

Efficient and Accurate SimRank-Based Similarity Joins: Experiments, Analysis, and Improvement

PSM: A New Re-Ranking Algorithm for Named-Page

Efficient and Contextual Ranking with Incomplete Preferences: an Equivalence Triangular Condensation Approach

Efficient Querying from Weighted Binary Codes

Efficient Top-K Query Processing Algorithms in Highly Distributed Environments

Crowdsourced Top- K Queries by Pairwise Preference Judgments with Confidence and Budget Control

Optimizing top-k retrieval: submodularity analysis and search strategies

Optimized top-k processing with global page scores on block-max indexes.

Quasi-Perfect and Distance-Optimal Codes Sum-Rank Codes

Diversified Spatial Keyword Query on Topic Coverage

A Prior-Free Weighting Scheme for Binary Code Ranking

A Confidence-Aware Top-K Query Processing Toolkit on Crowdsourcing

Efficient Pruning for Top-K Ranking Queries on Attribute-Wise Uncertain Datasets

Ranking with Diverse Intents and Correlated Contents.

Ranked Enumeration of Conjunctive Query Results