Abstract:The $k$d-tree is one of the most widely used data structures to manage multi-dimensional data. Due to the ever-growing data volume, it is imperative to consider parallelism in $k$d-trees. However, we observed challenges in existing parallel kd-tree implementations, for both constructions and updates. The goal of this paper is to develop efficient in-memory $k$d-trees by supporting high parallelism and cache-efficiency. We propose the Pkd-tree (Parallel $k$d-tree), a parallel $k$d-tree that is efficient both in theory and in practice. The Pkd-tree supports parallel tree construction, batch update (insertion and deletion), and various queries including k-nearest neighbor search, range query, and range count. We proved that our algorithms have strong theoretical bounds in work (sequential time complexity), span (parallelism), and cache complexity. Our key techniques include 1) an efficient construction algorithm that optimizes work, span, and cache complexity simultaneously, and 2) reconstruction-based update algorithms that guarantee the tree to be weight-balanced. With the new algorithmic insights and careful engineering effort, we achieved a highly optimized implementation of the Pkd-tree. We tested Pkd-tree with various synthetic and real-world datasets, including both uniform and highly skewed data. We compare the Pkd-tree with state-of-the-art parallel $k$d-tree implementations. In all tests, with better or competitive query performance, Pkd-tree is much faster in construction and updates consistently than all baselines. We released our code.

A High Performance ApproximatekD Tree with Overlap

Pkd-tree: Parallel $k$d-tree with Batch Updates

Preserving-Ignoring Transformation Based Index for Approximate k Nearest Neighbor Search

An Approximate Nearest Neighbor Query Algorithm Based on B^Z-Tree

Algorithm for searching nearest-neighbor based on the bounded k-d tree

Optimizing Kd-Trees for Scalable Visual Descriptor Indexing

Fast approximate K neighbor method based on tree strategy and balanced K-means clustering

A Fast Two-Level Approximate Euclidean Minimum Spanning Tree Algorithm for High-Dimensional Data.

Adaptive Top-k Overlap Set Similarity Joins

Parallelization Optimization of KD-Tree Building Algorithm

KDTREE 2: Fortran 95 and C++ software to efficiently search for near neighbors in a multi-dimensional Euclidean space

Edge Propagation KD-Trees: Computing Approximate Nearest Neighbor Fields.

Dtrie-allpair: an Efficient Set T-Overlap Join Algorithm

Efficient Data-aware Distance Comparison Operations for High-Dimensional Approximate Nearest Neighbor Search

Efficient Parallel Processing of High-Dimensional Spatial K NN Queries

Efficient Nearest Neighbor Search Using Dynamic Programming

Parallel Outlier Detection Using KD-Tree Based on MapReduce

Exploring Bit-Difference for Approximate KNN Search in High-Dimensional Databases

A Tree-Based Incremental Overlapping Clustering Method Using the Three-Way Decision Theory

O2iJoin: an Efficient Index-Based Algorithm for Overlap Interval Join.

Cover Trees Revisited: Exploiting Unused Distance and Direction Information