Abstract:Effective vector representation models, e.g., word2vec and node2vec, embed real-world objects such as images and documents in high dimensional vector space. In the meanwhile, the objects are often associated with attributes such as timestamps and prices. Many scenarios need to jointly query the vector representations of the objects together with their attributes. These queries can be formalized as range-filtering approximate nearest neighbor search (ANNS) queries. Specifically, given a collection of data vectors, each associated with an attribute value whose domain has a total order. The range-filtering ANNS consists of a query range and a query vector. It finds the approximate nearest neighbors of the query vector among all the data vectors whose attribute values fall in the query range. Existing approaches suffer from a rapidly degrading query performance when the query range width shifts. The query performance can be optimized by a solution that builds an ANNS index for every possible query range; however, the index time and index size become prohibitive -- the number of query ranges is quadratic to the number n of data vectors. To overcome these challenges, for the query range contains all attribute values smaller than a user-provided threshold, we design a structure called the segment graph whose index time and size are the same as a single ANNS index, yet can losslessly compress the n ANNS indexes, reducing the indexing cost by a factor of Ω(n). To handle general range queries, we propose a 2D segment graph with average-case index size O(n log n) to compress n segment graphs, breaking the quadratic barrier. Extensive experiments conducted on real-world datasets show that our proposed structures outperformed existing methods significantly; our index also exhibits superior scalability.

Fast Approximate Nearest Neighbor Search with the Navigating Spreading-out Graph.

Multiattribute approximate nearest neighbor search based on navigable small world graph

Optimizing Graph-based Approximate Nearest Neighbor Search: Stronger and Smarter

A comprehensive survey and experimental comparison of graph-based approximate nearest neighbor search

Fast Approximate Nearest Neighbor Search with a Dynamic Exploration Graph using Continuous Refinement

Satellite System Graph: Towards the Efficiency Up-Boundary of Graph-Based Approximate Nearest Neighbor Search

High Dimensional Similarity Search with Satellite System Graph: Efficiency, Scalability, and Unindexed Query Compatibility

SeRF: Segment Graph for Range-Filtering Approximate Nearest Neighbor Search

Revisiting the Index Construction of Proximity Graph-Based Approximate Nearest Neighbor Search

Relative NN-Descent: A Fast Index Construction for Graph-Based Approximate Nearest Neighbor Search

Efficient and Robust Approximate Nearest Neighbor Search Using Hierarchical Navigable Small World Graphs

Probabilistic Routing for Graph-Based Approximate Nearest Neighbor Search

Constrained All-k-Nearest-Neighbor Search

Fast Approximate Nearest Neighbor Search Via K-Diverse Nearest Neighbor Graph.

Theoretical and Empirical Analysis of Adaptive Entry Point Selection for Graph-based Approximate Nearest Neighbor Search

Enhancing HNSW Index for Real-Time Updates: Addressing Unreachable Points and Performance Degradation

Efficient and Effective Retrieval of Dense-Sparse Hybrid Vectors using Graph-based Approximate Nearest Neighbor Search

Proximity Graph Maintenance for Fast Online Nearest Neighbor Search

ParlayANN: Scalable and Deterministic Parallel Graph-Based Approximate Nearest Neighbor Search Algorithms

Bridging Software-Hardware for CXL Memory Disaggregation in Billion-Scale Nearest Neighbor Search

NDSEARCH: Accelerating Graph-Traversal-Based Approximate Nearest Neighbor Search through Near Data Processing