Abstract:We propose a novel approach to solving the approximate k-nearest neighbor search problem in metric spaces. The search structure is based on a navigable small world graph with vertices corresponding to the stored elements, edges to links between them, and a variation of greedy algorithm for searching. The navigable small world is created simply by keeping old Delaunay graph approximation links produced at the start of construction. The approach is very universal, defined in terms of arbitrary metric spaces and at the same time it is very simple. The algorithm handles insertions in the same way as queries: by finding approximate neighbors for the inserted element and connecting it to them. Both search and insertion can be done in parallel requiring only local information from the structure. The structure can be made distributed. The accuracy of the probabilistic k-nearest neighbor queries can be adjusted without rebuilding the structure.The performed simulation for data in the Euclidean spaces shows that the structure built using the proposed algorithm has small world navigation properties with log2(n) insertion and search complexity at fixed accuracy, and performs well at high dimensionality. Simulation on a CoPHiR dataset revealed its high efficiency in case of large datasets (more than an order of magnitude less metric computations at fixed recall) compared to permutation indexes. Only 0.03% of the 10 million 208-dimensional vector dataset is needed to be evaluated to achieve 0.999 recall (virtually exact search). For recall 0.93 processing speed 2800queries/s can be achieved on a dual Intel X5675 Xenon server node with Java implementation.

Large Scale Nearest Neighbors Search Based on Neighborhood Graph.

Accelerating Exact Nearest Neighbor Search in High Dimensional Euclidean Space Via Block Vectors

Constrained All-k-Nearest-Neighbor Search

Scalable Nearest Neighbor Search based on kNN Graph

Fast Approximate Nearest Neighbor Search Via K-Diverse Nearest Neighbor Graph.

Scalable K-Nn Graph Construction for Visual Descriptors

Approximate Nearest Neighbor Search on High Dimensional Data — Experiments, Analyses, and Improvement

A scalable solution to the nearest neighbor search problem through local-search methods on neighbor graphs

Graph-based Approximate NN Search: A Revisit

Large-Scale Visual Search with Binary Distributed Graph at Alibaba

Graph Based Nearest Neighbor Search: Promises and Failures

Unleashing Graph Partitioning for Large-Scale Nearest Neighbor Search

Grid-Based Indexing and Search Algorithms for Large-Scale and High-Dimensional Data

Fast Nearest Neighbor Search Based on Approximate K-Nn Graph

Scalable Nearest Neighbor Query Processing Based on Inverted Grid Index

Fast answering k-nearest-neighbor queries over large image databases using dual distance transformation

Neighborhood Discriminant Hashing for Large-Scale Image Retrieval

Approximate nearest neighbor algorithm based on navigable small world graphs

HDIdx: High-dimensional indexing for efficient approximate nearest neighbor search

Hierarchical Indexing Scheme for Fast Search in Large-Scale Image Database

Hierarchical indexing scheme for fast search in a large-scale image database