Abstract:Spatial data is ubiquitous. Massive amounts of data are generated every day from a plethora of sources such as billions of GPS-enabled devices (e.g., cell phones, cars, and sensors), consumer-based applications (e.g., Uber and Strava), and social media platforms (e.g., location-tagged posts on Facebook, Twitter, and Instagram). This exponential growth in spatial data has led the research community to build systems and applications for efficient spatial data processing. In this study, we apply a recently developed machine-learned search technique for single-dimensional sorted data to spatial indexing. Specifically, we partition spatial data using six traditional spatial partitioning techniques and employ machine-learned search within each partition to support point, range, distance, and spatial join queries. Adhering to the latest research trends, we tune the partitioning techniques to be instance-optimized. By tuning each partitioning technique for optimal performance, we demonstrate that: (i) grid-based index structures outperform tree-based index structures (from 1.23$\times$ to 2.47$\times$), (ii) learning-enhanced variants of commonly used spatial index structures outperform their original counterparts (from 1.44$\times$ to 53.34$\times$ faster), (iii) machine-learned search within a partition is faster than binary search by 11.79% - 39.51% when filtering on one dimension, (iv) the benefit of machine-learned search diminishes in the presence of other compute-intensive operations (e.g. scan costs in higher selectivity queries, Haversine distance computation, and point-in-polygon tests), and (v) index lookup is the bottleneck for tree-based structures, which could potentially be reduced by linearizing the indexed partitions.

Indexing high-dimensional data for efficient in-memory similarity search

Contorting High Dimensional Data for Efficient Main Memory KNN Processing

Indexing High-Dimensional Data in Dual Distance Spaces

Novel High-Dimensional Indexing Structure Based on Dual-Distance Metric

Main Memory Indexing: the Case for Bd-Tree

An Efficient and Compact Indexing Scheme for Large-Scale Data Store.

Angle-Tree: A New Index Structure for High-Dimensional Point Data

Efficient Metric Indexing for Similarity Search

Enhancing In-Memory Spatial Indexing with Learned Search

Indexing very high-dimensional sparse and quasi-sparse vectors for similarity searches

DForest: A Minimal Dimensionality-Aware Indexing for High-Dimensional Exact Similarity Search

LuSH: A Generic High-Dimensional Index Framework.

An Adaptive Index Structure for Similarity Search in Large Image Databases

Indexing high-dimensional data in dual distance spaces: a symmetrical encoding approach

The HV-tree: a memory hierarchy aware version index

Composite Distance Transformation for Indexing and K -Nearest-neighbor Searching in High-Dimensional Spaces

The HV-tree

Speed Up Linear Scan in High-Dimensions by Sorting One-Dimensional Projections

qwLSH: Cache-conscious Indexing for Processing Similarity Search Query Workloads in High-Dimensional Spaces

Fast data series indexing for in-memory data

Fast, Incremental Inverted Indexing in Main Memory for Web-Scale Collections