Abstract:Among many solutions to the high-dimensional approximate nearest neighbor (ANN) search problem, locality sensitive hashing (LSH) is known for its sub-linear query time and robust theoretical guarantee on query accuracy. Traditional LSH methods can generate a small number of candidates quickly from hash tables but suffer from large index sizes and hash boundary problems. Recent studies to address these issues often incur extra overhead to identify eligible candidates or remove false positives, making query time no longer sub-linear. To address this dilemma, in this paper we propose a novel LSH scheme called DB-LSH which supports efficient ANN search for large high-dimensional datasets. It organizes the projected spaces with multi-dimensional indexes rather than using fixed-width hash buckets. Our approach can significantly reduce the space cost as by avoiding the need to maintain many hash tables for different bucket sizes. During the query phase of DB-LSH, a small number of high-quality candidates can be generated efficiently by dynamically constructing query-based hypercubic buckets with the required widths through index-based window queries. For a dataset of $n$ $d$-dimensional points with approximation ratio $c$, our rigorous theoretical analysis shows that DB-LSH achieves a smaller query cost ${O(n^{\rho^*} d\log n)}$, where ${\rho^*}$ is bounded by ${1/c^{\alpha}}$ while the bound is ${1/c}$ in the existing work. An extensive range of experiments on real-world data demonstrates the superiority of DB-LSH over state-of-the-art methods on both efficiency and accuracy.

Design on Strong Associative OLAP-based Dense Set Retrieval Method

Towards the Building of a Dense-Region-based OLAP System

DROLAP - A Dense-Region Based Approach to On-Line Analytical Processing

SCANCHUNK:AN EFFICIENT ALGORITHM FOR HUNTING DENSE REGIONS IN DATA CUBE

Orthogonal Locality Preserving Indexing

Shape Retrieval Method of 3D Models Based on Shape Distribution Graph and BP Neural Network

Requirement-Based Data Cube Schema Design

Level-aware Collective Spatial Keyword Queries.

Data Warehouse Native Feature Based OLAP Querying with Keywords

OLAP Query Processing Algorithm Based on Relational Storage.

The Study of Olap Based on RDB

Distributed scheduling and storage scheme based on LSM-OCTree for spatiotemporal stream

New Distributed Spatial Query Optimization Approach by Using Query Analyzer

Efficient Distributed Query Processing in Large RFID-enabled Supply Chains

Exploring Correlated Subspaces for Efficient Query Processing in Sparse Databases

A Spatio-Temporal Local Association Query Algorithm for Multi-Source Remote Sensing Big Data

Gsmat: A Scalable Sparse Matrix-based Join for SPARQL Query Processing

A Hybrid Approach Combining R*-Tree and k-d Trees to Improve Linked Open Data Query Performance

Recover Fine-Grained Spatial Data from Coarse Aggregation

LISA: A Learned Index Structure for Spatial Data

DB-LSH: Locality-Sensitive Hashing with Query-based Dynamic Bucketing