Abstract:Recent studies have shown that Dense Retrieval (DR) techniques can significantly improve the performance of first-stage retrieval in IR systems. Despite its empirical effectiveness, the application of DR is still limited. In contrast to statistic retrieval models that rely on highly efficient inverted index solutions, DR models build dense embeddings that are difficult to be pre-processed with most existing search indexing systems. To avoid the expensive cost of brute-force search, the Approximate Nearest Neighbor (ANN) algorithm and corresponding indexes are widely applied to speed up the inference process of DR models. Unfortunately, while ANN can improve the efficiency of DR models, it usually comes with a significant price on retrieval performance. To solve this issue, we propose JTR, which stands for Joint optimization of TRee-based index and query encoding. Specifically, we design a new unified contrastive learning loss to train tree-based index and query encoder in an end-to-end manner. The tree-based negative sampling strategy is applied to make the tree have the maximum heap property, which supports the effectiveness of beam search well. Moreover, we treat the cluster assignment as an optimization problem to update the tree-based index that allows overlapped clustering. We evaluate JTR on numerous popular retrieval benchmarks. Experimental results show that JTR achieves better retrieval performance while retaining high system efficiency compared with widely-adopted baselines. It provides a potential solution to balance efficiency and effectiveness in neural retrieval system designs.

Research on Streamline Inter-relevant Successive Trees

Backwards Search Algorithm of Double-Sorted Inter-relevant Successive Trees

Research on Dynamic Index of Streamline Dynamic Successive Trees

Research on the Compression Algorithm with Querying Without Decompression Based on the Streamline Dynamic Successive Trees

Constructing Tree-based Index for Efficient and Effective Dense Retrieval

Scalable Top-K Spatial Keyword Search

A Tree-Based Indexing Approach for Diverse Textual Similarity Search

The Scalable Vocabulary Tree Based Model for Sub-Image Retrieval.

Research of Adaptive Index Based on Slide Window for Spatial-Textual Query

A Novel Full-Text Indexing Model for Chinese Text Retrieval

A New Full-Text Indexing Model with Low Space Overhead for Chinese Text Retrieval

A Collaborative Retrieval System - Full Text Base and Database

STLIS: A Scalable Two-Level Index Scheme for Big Data in IoT

IR-Tree: an Efficient Index for Geographic Document Search

Understanding Differential Search Index for Text Retrieval

An Efficient Framework for Exact Set Similarity Search Using Tree Structure Indexes.

A Survey of Text Information Retrieval Model

A Two-Tier Distributed Full-Text Indexing System

An Improved Text Retrieval Algorithm Based On Suffix Tree Similarity Measure

An Efficient Structural Index for Branching Path Queries.

An Efficient Peer-to-peer Indexing Tree Structure for Multidimensional Data.