Abstract:Spatial data is ubiquitous. Massive amounts of data are generated every day from a plethora of sources such as billions of GPS-enabled devices (e.g., cell phones, cars, and sensors), consumer-based applications (e.g., Uber and Strava), and social media platforms (e.g., location-tagged posts on Facebook, Twitter, and Instagram). This exponential growth in spatial data has led the research community to build systems and applications for efficient spatial data processing. In this study, we apply a recently developed machine-learned search technique for single-dimensional sorted data to spatial indexing. Specifically, we partition spatial data using six traditional spatial partitioning techniques and employ machine-learned search within each partition to support point, range, distance, and spatial join queries. Adhering to the latest research trends, we tune the partitioning techniques to be instance-optimized. By tuning each partitioning technique for optimal performance, we demonstrate that: (i) grid-based index structures outperform tree-based index structures (from 1.23$\times$ to 2.47$\times$), (ii) learning-enhanced variants of commonly used spatial index structures outperform their original counterparts (from 1.44$\times$ to 53.34$\times$ faster), (iii) machine-learned search within a partition is faster than binary search by 11.79% - 39.51% when filtering on one dimension, (iv) the benefit of machine-learned search diminishes in the presence of other compute-intensive operations (e.g. scan costs in higher selectivity queries, Haversine distance computation, and point-in-polygon tests), and (v) index lookup is the bottleneck for tree-based structures, which could potentially be reduced by linearizing the indexed partitions.

Random mappings designed for commercial search engines

Fast Nearest Subspace Search Via Random Angular Hashing.

Randomized sub-vectors hashing for high-dimensional image feature matching.

A vector space model for automatic indexing

Random Angular Projection for Fast Nearest Subspace Search

Finding Semantic Equivalence of Text Using Random Index Vectors.

On random embeddings and their application to optimisation

Fast Object Retrieval Using Direct Spatial Matching

Indexing Sub-Vector Distance for High-Dimensional Feature Matching.

Multiple Randomized Sub-vectors Quantization Hashing for High-Dimensional Image Feature Matching

Geometric Covering using Random Fields

Indexing very high-dimensional sparse and quasi-sparse vectors for similarity searches

Random Projections of Sparse Adjacency Matrices

HAP: an Efficient Hamming Space Index Based on Augmented Pigeonhole Principle

Enhancing In-Memory Spatial Indexing with Learned Search

Random Feature Mapping with Signed Circulant Matrix Projection

Randomised subspace methods for non-convex optimization, with applications to nonlinear least-squares

Ranking on data manifolds

Johnson-Lindenstrauss Lemma, Linear and Nonlinear Random Projections, Random Fourier Features, and Random Kitchen Sinks: Tutorial and Survey

Fast Search In Large-Scale Image Database Using Vector Quantization

Mind Mappings: Enabling Efficient Algorithm-Accelerator Mapping Space Search