Abstract:Approximate Nearest Neighbor Search (ANNS) is widely used in many fields (e.g., recommender systems). In recent years, the graph-based ANNS methods have attracted the attention of many researchers due to their superiority compared to non-graph-based methods. Compared with traditional recommender systems, mobile recommender systems have higher latency requirements. The graph-based ANNS method faces the following challenges that make it difficult to meet the requirements. (1) Poor connectivity. Due to the limitation of the construction algorithm, the connectivity of the graph is poor, which in turn affects the search performance. (2) Redundant search. The existing search algorithm uses sufficiently long search steps for all queries to achieve high search accuracy. However, the query search steps follow the long-tailed distribution that brings the redundant search, e.g., for more than 40 % of the queries, 87.4 % of the search overhead is redundant. We propose two optimization strategies to tackle the above challenges. (1) Reverse connection enhancement strategy. In the graph construction process, we increase the in-degree of the point to be inserted to enhance the graph connectivity, while keeping the out-degree low to maintain the high search efficiency. (2) Query aware early termination strategy. We identify regional features to predict the number of remaining search steps to achieve dynamic search termination and reduce the redundant search overhead. Finally, we verify the proposed solutions on multiple representative datasets. Compared with the state-of-the-art graph-based algorithm, our solutions can improve the search speed up to 1.21x when the recall rate equals 0.95.

Fast Approximate Nearest Neighbor Search Via K-Diverse Nearest Neighbor Graph.

Accelerating Exact Nearest Neighbor Search in High Dimensional Euclidean Space Via Block Vectors

Fast Nearest Neighbor Search Based on Approximate K-Nn Graph

Constrained All-k-Nearest-Neighbor Search

Approximate K-Nn Graph Construction: A Generic Online Approach

Fast kNN Graph Construction with Locality Sensitive Hashing.

Graph-based Approximate NN Search: A Revisit

Scalable Nearest Neighbor Search based on kNN Graph

K-Nn Graph Construction: a Generic Online Approach

Fast Approximate Nearest Neighbor Search with a Dynamic Exploration Graph using Continuous Refinement

Large Scale Nearest Neighbors Search Based on Neighborhood Graph.

Relative NN-Descent: A Fast Index Construction for Graph-Based Approximate Nearest Neighbor Search

Fast Approximate Nearest Neighbor Search with the Navigating Spreading-out Graph.

Optimizing Graph-based Approximate Nearest Neighbor Search: Stronger and Smarter

Fast Approximate K NN Graph Construction for High Dimensional Data Via Recursive Lanczos Bisection

Fast k-Nearest Neighbour Search via Dynamic Continuous Indexing

Scalable $k$-NN graph construction.

Graph Based Nearest Neighbor Search: Promises and Failures

Efficient Data-aware Distance Comparison Operations for High-Dimensional Approximate Nearest Neighbor Search

Efficient kNN Algorithm Based on Graph Sparse Reconstruction.

On Efficiently Finding Reverse K-Nearest Neighbors over Uncertain Graphs