Abstract:Similarity search plays an important role in many applications involving high-dimensional data. Due to the known dimensionality curse, the performance of most existing indexing structures degrades quickly as the feature dimensionality increases. Hashing methods, such as locality sensitive hashing (LSH) and its variants, have been widely used to achieve fast approximate similarity search by trading search quality for efficiency. However, most existing hashing methods make use of randomized algorithms to generate hash codes without considering the specific structural information in the data. In this paper, we propose a novel hashing method, namely, robust hashing with local models (RHLM), which learns a set of robust hash functions to map the high-dimensional data points into binary hash codes by effectively utilizing local structural information. In RHLM, for each individual data point in the training dataset, a local hashing model is learned and used to predict the hash codes of its neighboring data points. The local models from all the data points are globally aligned so that an optimal hash code can be assigned to each data point. After obtaining the hash codes of all the training data points, we design a robust method by employing l2,1 -norm minimization on the loss function to learn effective hash functions, which are then used to map each database point into its hash code. Given a query data point, the search process first maps it into the query hash code by the hash functions and then explores the buckets, which have similar hash codes to the query hash code. Extensive experimental results conducted on real-life datasets show that the proposed RHLM outperforms the state-of-the-art methods in terms of search quality and efficiency.

SELSH: A Hashing Scheme for Approximate Similarity Search with Early Stop Condition

SES-LSH: Shuffle-Efficient Locality Sensitive Hashing for Distributed Similarity Search

SK-LSH

Sk-Lsh : An Efficient Index Structure For Approximate Nearest Neighbor Search

BCH-LSH: a New Scheme of Locality-Sensitive Hashing.

Robust hashing with local models for approximate similarity search.

Data-oriented locality sensitive hashing.

Preserving-Ignoring Transformation Based Index for Approximate k Nearest Neighbor Search

Dsh: Data Sensitive Hashing For High-Dimensional K-Nn Search

CLSH: Cluster-based Locality-Sensitive Hashing

Sparse Semantic Hashing for Efficient Large Scale Similarity Search

DET-LSH: A Locality-Sensitive Hashing Scheme with Dynamic Encoding Tree for Approximate Nearest Neighbor Search

DB-LSH: Locality-Sensitive Hashing with Query-based Dynamic Bucketing

Improving Similarity Search with High-dimensional Locality-sensitive Hashing

Least Square Regularized Spectral Hashing for Similarity Search

Locality-Sensitive Hashing Scheme based on Longest Circular Co-Substring

A PG-LSH Similarity Search Method for Cloud Storage

Sharing hash codes for multiple purposes

Locality sensitive hashing scheme based on online-learning

Frequency Based Locality Sensitive Hashing

qwLSH: Cache-conscious Indexing for Processing Similarity Search Query Workloads in High-Dimensional Spaces