Abstract:Approximate Nearest Neighbor Search (ANNS) is widely used in many fields (e.g., recommender systems). In recent years, the graph-based ANNS methods have attracted the attention of many researchers due to their superiority compared to non-graph-based methods. Compared with traditional recommender systems, mobile recommender systems have higher latency requirements. The graph-based ANNS method faces the following challenges that make it difficult to meet the requirements. (1) Poor connectivity. Due to the limitation of the construction algorithm, the connectivity of the graph is poor, which in turn affects the search performance. (2) Redundant search. The existing search algorithm uses sufficiently long search steps for all queries to achieve high search accuracy. However, the query search steps follow the long-tailed distribution that brings the redundant search, e.g., for more than 40 % of the queries, 87.4 % of the search overhead is redundant. We propose two optimization strategies to tackle the above challenges. (1) Reverse connection enhancement strategy. In the graph construction process, we increase the in-degree of the point to be inserted to enhance the graph connectivity, while keeping the out-degree low to maintain the high search efficiency. (2) Query aware early termination strategy. We identify regional features to predict the number of remaining search steps to achieve dynamic search termination and reduce the redundant search overhead. Finally, we verify the proposed solutions on multiple representative datasets. Compared with the state-of-the-art graph-based algorithm, our solutions can improve the search speed up to 1.21x when the recall rate equals 0.95.

Approximate K-Nn Graph Construction: A Generic Online Approach

K-Nn Graph Construction: a Generic Online Approach

Fast Nearest Neighbor Search Based on Approximate K-Nn Graph

Online map matching by indexing approximate road segments

Fast Approximate Nearest Neighbor Search Via K-Diverse Nearest Neighbor Graph.

Fast kNN Graph Construction with Locality Sensitive Hashing.

Scalable K-Nn Graph Construction for Visual Descriptors

On the Merge of K-Nn Graph

Scalable $k$-NN graph construction.

Scalable Nearest Neighbor Search based on kNN Graph

Fast Approximate K NN Graph Construction for High Dimensional Data Via Recursive Lanczos Bisection

Graph-based Approximate NN Search: A Revisit

Approximate nearest neighbor algorithm based on navigable small world graphs

Large Scale Nearest Neighbors Search Based on Neighborhood Graph.

Relative NN-Descent: A Fast Index Construction for Graph-Based Approximate Nearest Neighbor Search

Graph-decomposed K-Nn Searching Algorithm on Road Network

Optimizing Graph-based Approximate Nearest Neighbor Search: Stronger and Smarter

Simpler is More: Efficient Top-K Nearest Neighbors Search on Large Road Networks

Graph-Indexed kNN Query Optimization on Road Network

Efficient and Robust Approximate Nearest Neighbor Search Using Hierarchical Navigable Small World Graphs

Effective and General Distance Computation for Approximate Nearest Neighbor Search