Abstract:In information retrieval systems, search parameters are optimized to ensure high effectiveness based on a set of past searches and these optimized parameters are then used as the system configuration for all subsequent queries. A better approach, however, would be to adapt the parameters to fit the query at hand. Selective query expansion is one such an approach, in which the system decides automatically whether or not to expand the query, resulting in two possible system configurations. This approach was extended recently to include many other parameters, leading to many possible system configurations where the system automatically selects the best configuration on a per-query basis. To determine the ideal configurations to use on a per-query basis in real-world systems we developed a method in which a restricted number of possible configurations is pre-selected and then used in a meta-search engine that decides the best search configuration on a per query basis. We define a risk-sensitive approach for configuration pre-selection that considers the risk-reward trade-off between the number of configurations kept, and system effectiveness. For final configuration selection, the decision is based on query feature similarities. We find that a relatively small number of configurations (20) selected by our risk-sensitive model is sufficient to increase effectiveness by about 15% according(P@10, nDCG@10) when compared to traditional grid search using a single configuration and by about 20% when compared to learning to rank documents. Our risk-sensitive approach works for both diversity- and ad hoc-oriented searches. Moreover, the similarity-based selection method outperforms the more sophisticated approaches. Thus, we demonstrate the feasibility of developing per-query information retrieval systems, which will guide future research in this direction.

Document Selection in a Distributed Search Engine Architecture

A LDA Topic Model Based Collection Selection Method for Distributed Information Retrieval

Effective Keyword-Based Selection of Relational Databases.

Approach for multi-dimensional associated heterogeneous engineering document semantic retrieval

Selective Query Processing: a Risk-Sensitive Selection of System Configurations

New Distributed Spatial Query Optimization Approach by Using Query Analyzer

The Architectures of Engineering Database Management Systems

Review on Distributed Search Engine Model

A Distributed Framework for Scalable Search over Encrypted Documents

Efficient Method for Database Selection

Keyword Search Based XML Data Source Selection

Knowledge Based Collection Selection for Distributed Information Retrieval

Distributed Architecture for Large Scale Image-Based Search

De-DSI: Decentralised Differentiable Search Index

Distributed Feature Sets for Document Specific Key-Phrase Extraction

An Efficient Multiple Data Sources Selection Algorithm in Data-Sharing Environments

Wide Area Selection As a Hyperdocument Search Interface.

SEREIA: document store exploration through keywords

On-Line Selection Of Distinguishing Elements For Focused Information Retrieval

A survey in semantic search technologies

Allocating images and selecting image collections for distributed visual search