Abstract:Recent studies have shown that Dense Retrieval (DR) techniques can significantly improve the performance of first-stage retrieval in IR systems. Despite its empirical effectiveness, the application of DR is still limited. In contrast to statistic retrieval models that rely on highly efficient inverted index solutions, DR models build dense embeddings that are difficult to be pre-processed with most existing search indexing systems. To avoid the expensive cost of brute-force search, the Approximate Nearest Neighbor (ANN) algorithm and corresponding indexes are widely applied to speed up the inference process of DR models. Unfortunately, while ANN can improve the efficiency of DR models, it usually comes with a significant price on retrieval performance. To solve this issue, we propose JTR, which stands for Joint optimization of TRee-based index and query encoding. Specifically, we design a new unified contrastive learning loss to train tree-based index and query encoder in an end-to-end manner. The tree-based negative sampling strategy is applied to make the tree have the maximum heap property, which supports the effectiveness of beam search well. Moreover, we treat the cluster assignment as an optimization problem to update the tree-based index that allows overlapped clustering. We evaluate JTR on numerous popular retrieval benchmarks. Experimental results show that JTR achieves better retrieval performance while retaining high system efficiency compared with widely-adopted baselines. It provides a potential solution to balance efficiency and effectiveness in neural retrieval system designs.

A Fast Trie Tree Index Construction Algorithm Using Frequency Characteristic

A Fast Sah-Based Construction of Octree

Research on a Stochastic Distribution Multibit Trie Tree IP Classification Algorithm

Research of Optimization on Double-Array Trie and its Application

Efficient Hash Chain Traversal Based on Binary Tree Inorder Traversal

2D Trie for Fast Parsing.

A Non-Collision Hash Trie-Tree Based Fast IP Classification Algorithm.

A Generic Approach For Bulk Loading Trie-Based Index Structures On External Storage

System of Twice-Gathering Information and Research of Information Fingerprint HashTrie

Research of an Improved Double-Array Trie Tree Algorithm

Design of Fast Multiple String Searching Based on Improved Prefix Tree

Efficient B-tree Based Indexing for Cloud Data Processing.

Cuckoo Trie: Exploiting Memory-Level Parallelism for Efficient DRAM Indexing

An Efficient Word Lookup System by using Improved Trie Algorithm

Constructing Tree-based Index for Efficient and Effective Dense Retrieval

A Fast Two-Way Ip Lookup Algorithm Based Multibit-Trie

MergedTrie: Efficient textual indexing

Index Point Data Using Algebraic Lattice.

Towards Large-Scale Object Instance Search: A Multi-Block N-Ary Trie

Research of an improved algorithm for Chinese word segmentation dictionary based on double-array Trie-tree

Recursive Shift Indexing : A Fast Multi-Pattern String Matching Algorithm