Abstract:Approximate nearest neighbor (ANN) search in high-dimensional Euclidean space has a broad range of applications. Among existing ANN algorithms, graph-based methods have shown superior performance in terms of the time-accuracy trade-off. However, they face performance bottlenecks due to the random memory accesses caused by the searching process on the graph indices and the costs of computing exact distances to guide the searching process. To relieve the bottlenecks, a recent method named NGT-QG makes an attempt by integrating quantization and graph. It (1) replicates and stores the quantization codes of a vertex's neighbors compactly so that they can be accessed sequentially, and (2) uses a SIMD-based implementation named FastScan to efficiently estimate distances based on the quantization codes in batch for guiding the searching process. While NGT-QG achieves promising improvements over the vanilla graph-based methods, it has not fully unleashed the potential of integrating quantization and graph. For instance, it entails a re-ranking step to compute exact distances at the end, which introduces extra random memory accesses; its graph structure is not jointly designed considering the in-batch nature of FastScan, which causes wastes of computation in searching. In this work, following NGT-QG, we present a new method named SymphonyQG, which achieves more symphonious integration of quantization and graph (e.g., it avoids the explicit re-ranking step and refines the graph structure to be more aligned with FastScan). Based on extensive experiments on real-world datasets, SymphonyQG establishes the new state-of-the-art in terms of the time-accuracy trade-off.

Projected Residual Vector Quantization for ANN Search

Large-scale Image Retrieval Based on Boosting Iterative Quantization Hashing with Query-Adaptive Reranking.

Local Deep Learning Quantization for Approximate Nearest Neighbor Search

Transformed Residual Quantization for Approximate Nearest Neighbor Search

Equal-Average Equal-Variance Equal-Norm Nearest Neighbor Search Algorithm for Vector Quantization

Vector and Line Quantization for Billion-scale Similarity Search on GPUs

Mean-Removed Product Quantization for Approximate Nearest Neighbor Search.

Hash Learning with Variable Quantization for Large-scale Retrieval

Exclusive visual descriptor quantization

Fast Norm-Ordered Nearest-Neighbor Codeword Search Algorithms For Image Vector Quantization

Equal-Average Equal-Variance Nearest Neighbor Search Algorithm Based on Hadamard Transform

Hierarchical quantization for billion-scale similarity retrieval on GPUs

Deep Scalable Supervised Quantization by Self-Organizing Map

An efficient encoding algorithm for vector quantization based on subvector technique.

Scalable Image Retrieval by Sparse Product Quantization

Efficient Large-scale Approximate Nearest Neighbor Search on the GPU

Mean-Removed Product Quantization for Large-scale Image Retrieval

JUNO: Optimizing High-Dimensional Approximate Nearest Neighbour Search with Sparsity-Aware Algorithm and Ray-Tracing Core Mapping

Improving Bilayer Product Quantization for Billion-Scale Approximate Nearest Neighbors in High Dimensions

SymphonyQG: Towards Symphonious Integration of Quantization and Graph for Approximate Nearest Neighbor Search

Online Optimized Product Quantization