Abstract:We study the query version of the approximate heavy hitter and quantile problems. In the former problem, the input is a parameter $\varepsilon$ and a set $P$ of $n$ points in $\mathbb{R}^d$ where each point is assigned a color from a set $C$, and we want to build a structure s.t. given any geometric range $\gamma$, we can efficiently find a list of approximate heavy hitters in $\gamma\cap P$, i.e., colors that appear at least $\varepsilon |\gamma \cap P|$ times in $\gamma \cap P$, as well as their frequencies with an additive error of $\varepsilon |\gamma \cap P|$. In the latter problem, each point is assigned a weight from a totally ordered universe and the query must output a sequence $S$ of $1+1/\varepsilon$ weights s.t. the $i$-th weight in $S$ has approximate rank $i\varepsilon|\gamma\cap P|$, meaning, rank $i\varepsilon|\gamma\cap P|$ up to an additive error of $\varepsilon|\gamma\cap P|$. Previously, optimal results were only known in 1D [WY11] but a few sub-optimal methods were available in higher dimensions [AW17, ACH+12]. We study the problems for 3D halfspace and dominance queries. We consider the real RAM model with integer registers of size $w=\Theta(\log n)$ bits. For dominance queries, we show optimal solutions for both heavy hitter and quantile problems: using linear space, we can answer both queries in time $O(\log n + 1/\varepsilon)$. Note that as the output size is $\frac{1}{\varepsilon}$, after investing the initial $O(\log n)$ searching time, our structure takes on average $O(1)$ time to find a heavy hitter or a quantile! For more general halfspace heavy hitter queries, the same optimal query time can be achieved by increasing the space by an extra $\log_w\frac{1}{\varepsilon}$ (resp. $\log\log_w\frac{1}{\varepsilon}$) factor in 3D (resp. 2D). By spending extra $\log^{O(1)}\frac{1}{\varepsilon}$ factors in time and space, we can also support quantile queries.

Correlation-aware Partitioning for Skewed Range Query Optimization

Join Query Optimization Based on MapReduce under Skewed Data

Time-Based Trajectory Data Partitioning for Efficient Range Query.

A Load Balancing Strategy Based on Data Correlation in Cloud Computing

Effective Spatial Data Partitioning for Scalable Query Processing

A Range Query Scheme for Spatial Data with Shuffled Differential Privacy

Exploring Correlated Subspaces for Efficient Query Processing in Sparse Databases

Cost-Based Optimization Of Logical Partitions For A Query Workload In A Hadoop Data Warehouse

A Grid-Aided and STR-Tree-based Algorithm for Partitioning Vector Data

Range Top/Bottom k Queries in OLAP Sparse Data Cubes

A spatial data partition algorithm based on statistical cluster

A Parallel Varied Density-Based Clustering Algorithm with Optimized Data Partition

A Study of Performance Optimization Method for Massive Spaito-temporal Data Based on Spatio-temporal Partition Clustering

NOCAP: Near-Optimal Correlation-Aware Partitioning Joins

AHEAD: Adaptive Hierarchical Decomposition for Range Query under Local Differential Privacy

On Range Summary Queries

An Adaptive Partition-Based Caching Approach for Efficient Range Queries on Key-Value Data.

An Adaptive Data Partitioning Scheme For Accelerating Exploratory Spark Sql Queries

Differentially Private Range Queries with Correlated Input Perturbation

Spatial Coding-Based Approach for Partitioning Big Spatial Data in Hadoop