Abstract:Recently, neural information retrieval (NeuIR) has attracted a lot of interests, where a variety of neural models have been proposed for the core ranking problem. Beyond the continuous refresh of the state-of-the-art neural ranking performance, the community calls for more analysis and understanding of the emerging neural ranking models. In this paper, we attempt to analyze these new models from a traditional view, namely term dependence. Without loss of generality, most existing neural ranking models could be categorized into three categories with respect to their underlying assumption on query term dependence, i.e., independent models, dependent models, and hybrid models. We conduct rigorous empirical experiments over several representative models from these three categories on a benchmark dataset and a large click-through dataset. Interestingly, we find that no single type of model can achieve a consistent win over others on different search queries. An oracle model which can select the right model for each query can obtain significant performance improvement. Based on the analysis we introduce an adaptive strategy for neural ranking models. We hypothesize that the term dependence in a query could be measured through the divergence between its independent and dependent representations. We thus propose a dependence gate based on such divergence representation to softly select neural ranking models for each query accordingly. Experimental results verify the effectiveness of the adaptive strategy.

A Novel Dependency Language Model for Information Retrieval

Exploration of Term Dependence in Sentence Retrieval.

Incorporating Semantic Knowledge with MRF Term Dependency Model in Medical Document Retrieval.

ON SENTENCE-BASED INFORMATION RETRIEVAL MODEL

Dependency Distance: A New Perspective on Syntactic Patterns in Natural Languages.

Modeling Image Data for Effective Indexing and Retrieval in Large General Image Databases.

Synergistic Interplay between Search and Large Language Models for Information Retrieval

Dependency-based Mixture Language Models.

A Novel Multi-modal Integration and Propagation Model for Cross-Media Information Retrieval

MRF Based Approach for Sentence Retrieval.

Language Models For Web Object Retrieval

Reliable, Adaptable, and Attributable Language Models with Retrieval

Dependency Based Chinese Sentence Realization

Understanding and Improving Neural Ranking Models from a Term Dependence View.

Latent Dependency Forest Models

Knowledge-Aware Query Expansion with Large Language Models for Textual and Relational Retrieval

A More Precise Model for Web Retrieval

On Models of Information Retrieval Processes

An Information-Theoretic Empirical Analysis of Dependency-Based Feature Types for Word Prediction Models.

Exploration of Term Relationship for Bayesian Network Based Sentence Retrieval

CRaDLe: Deep code retrieval based on semantic Dependency Learning