Abstract:High dimensional similarity search in large scale databases becomes an important challenge due to the advent of Internet. For such applications, specialized data structures are required to achieve computational efficiency. Traditional approaches relied on algorithmic constructions that are often data independent (such as Locality Sensitive Hashing) or weakly dependent (such as kd-trees, k-means trees). While supervised learning algorithms have been applied to related problems, those proposed in the literature mainly focused on learning hash codes optimized for compact embedding of the data rather than search efficiency. Consequently such an embedding has to be used with linear scan or another search algorithm. Hence learning to hash does not directly address the search efficiency issue. This paper considers a new framework that applies supervised learning to directly optimize a data structure that supports efficient large scale search. Our approach takes both search quality and computational cost into consideration. Specifically, we learn a boosted search forest that is optimized using pair-wise similarity labeled examples. The output of this search forest can be efficiently converted into an inverted indexing data structure, which can leverage modern text search infrastructure to achieve both scalability and efficiency. Experimental results show that our approach significantly outperforms the start-of-the-art learning to hash methods (such as spectral hashing), as well as state-of-the-art high dimensional search algorithms (such as LSH and k-means trees).

A Study of Learned KD Tree Based on Learned Index

Learned Index: A Comprehensive Experimental Evaluation

Learned Index for Non-Key Queries

RAKDB—Tree——一种基于近似区域的多维数据索引结构

ASLM: Adaptive Single Layer Model for Learned Index

A Survey of Learned Indexes for the Multi-dimensional Space

DTtree: A Novel Read/Write-Optimized Learned Index for Database Systems.

High-dimensional Learned Index Based on Space Division and Dimension Reduction

The RAKDB-Tree An Efficient Approximation-Based High-Dimensional Index Structure

Optimizing Kd-Trees for Scalable Visual Descriptor Indexing

A Simple Yet High-Performing On-disk Learned Index: Can We Have Our Cake and Eat it Too?

How Good Are Multi-dimensional Learned Indices? An Experimental Survey

Learning Tree - Neural Network-based Index for NDN Forwarding Plane.

Contorting High Dimensional Data for Efficient Main Memory KNN Processing

DILI: A Distribution-Driven Learned Index (Extended version)

Knowledge Distillation for High Dimensional Search Index.

Hybrid Indexes by Exploring Traditional B-Tree and Linear Regression.

Indexing High-Dimensional Data in Dual Distance Spaces

The ND-Tree: A Dynamic Indexing Technique for Multidimensional Non-ordered Discrete Data Spaces.

A Kd-Tree Based Dynamic Indexing Scheme For Video Retrieval And Geometry Matching

Learning to Search Efficiently in High Dimensions.