Abstract:In large-scale machine learning, of central interest is the problem of approximate nearest neighbor (ANN) search, where the goal is to query particular points that are close to a given object under certain metric. In this paper, we develop a novel data-driven ANN search algorithm where the data structure is learned by fast spectral technique based on s landmarks selected by approximate ridge leverage scores. We show that with overwhelming probability, our algorithm returns the (1+ϵ/4)\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$(1+\epsilon /4)$$\end{document}-ANN for any approximation parameter ϵ∈(0,1)\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$\epsilon \in (0,1)$$\end{document}. A remarkable feature of our algorithm is that it is computationally efficient. Specifically, learning k-length hash codes requires O((s3+ns2)logn)\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$O((s^3+ns^2)\log n)$$\end{document} running time and O(d2)\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$O(d^2)$$\end{document} extra space, and returning the (1+ϵ/4)\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$(1+\epsilon /4)$$\end{document}-ANN of the query needs O(klogn)\documentclass[12pt]{minimal}\usepackage{amsmath}\usepackage{wasysym}\usepackage{amsfonts}\usepackage{amssymb}\usepackage{amsbsy}\usepackage{mathrsfs}\usepackage{upgreek}\setlength{\oddsidemargin}{-69pt}\begin{document}$$O(k\log n)$$\end{document} running time. The experimental results on computer vision and natural language understanding tasks demonstrate the significant advantage of our algorithm compared to state-of-the-art methods.

Fast spectral analysis for approximate nearest neighbor search

Accelerating Exact Nearest Neighbor Search in High Dimensional Euclidean Space Via Block Vectors

SRS: solving c-approximate nearest neighbor queries in high dimensional euclidean space with a tiny index

Sk-Lsh : An Efficient Index Structure For Approximate Nearest Neighbor Search

A new fast inverted file-based algorithm for approximate nearest neighbor search without accuracy reduction

Efficient Nearest Neighbor Search in High Dimensional Hamming Space

Towards Efficient Index Construction and Approximate Nearest Neighbor Search in High-Dimensional Spaces.

Efficient and Effective Retrieval of Dense-Sparse Hybrid Vectors using Graph-based Approximate Nearest Neighbor Search

Subspace Collision: An Efficient and Accurate Framework for High-dimensional Approximate Nearest Neighbor Search

Fast High-dimensional Approximate Nearest Neighbor Search with Efficient Index Time and Space

JUNO: Optimizing High-Dimensional Approximate Nearest Neighbour Search with Sparsity-Aware Algorithm and Ray-Tracing Core Mapping

SK-LSH

An Efficient LSH Indexing on Discriminative Short Codes for High-Dimensional Nearest Neighbors.

Towards Secure Approximate <inline-formula> <tex-math notation="LaTeX">${k}$ </tex-math></inline-formula>-Nearest Neighbor Query Over Encrypted High-Dimensional Data

Improved Space-Efficient Approximate Nearest Neighbor Search Using Function Inversion

Effective and General Distance Computation for Approximate Nearest Neighbor Search

Efficient Reverse $k$ Approximate Nearest Neighbor Search over High-Dimensional Vectors

HCLAE: High Capacity Locally Aggregating Encodings for Approximate Nearest Neighbor Search

SeRF: Segment Graph for Range-Filtering Approximate Nearest Neighbor Search

Data-Dependent Locality Sensitive Hashing

Fast Nearest Subspace Search Via Random Angular Hashing.