Abstract:We study the query version of the approximate heavy hitter and quantile problems. In the former problem, the input is a parameter $\varepsilon$ and a set $P$ of $n$ points in $\mathbb{R}^d$ where each point is assigned a color from a set $C$, and we want to build a structure s.t. given any geometric range $\gamma$, we can efficiently find a list of approximate heavy hitters in $\gamma\cap P$, i.e., colors that appear at least $\varepsilon |\gamma \cap P|$ times in $\gamma \cap P$, as well as their frequencies with an additive error of $\varepsilon |\gamma \cap P|$. In the latter problem, each point is assigned a weight from a totally ordered universe and the query must output a sequence $S$ of $1+1/\varepsilon$ weights s.t. the $i$-th weight in $S$ has approximate rank $i\varepsilon|\gamma\cap P|$, meaning, rank $i\varepsilon|\gamma\cap P|$ up to an additive error of $\varepsilon|\gamma\cap P|$. Previously, optimal results were only known in 1D [WY11] but a few sub-optimal methods were available in higher dimensions [AW17, ACH+12]. We study the problems for 3D halfspace and dominance queries. We consider the real RAM model with integer registers of size $w=\Theta(\log n)$ bits. For dominance queries, we show optimal solutions for both heavy hitter and quantile problems: using linear space, we can answer both queries in time $O(\log n + 1/\varepsilon)$. Note that as the output size is $\frac{1}{\varepsilon}$, after investing the initial $O(\log n)$ searching time, our structure takes on average $O(1)$ time to find a heavy hitter or a quantile! For more general halfspace heavy hitter queries, the same optimal query time can be achieved by increasing the space by an extra $\log_w\frac{1}{\varepsilon}$ (resp. $\log\log_w\frac{1}{\varepsilon}$) factor in 3D (resp. 2D). By spending extra $\log^{O(1)}\frac{1}{\varepsilon}$ factors in time and space, we can also support quantile queries.

External Memory Three-Sided Range Reporting and Top-$k$ Queries with Sublogarithmic Updates

External Memory Orthogonal Range Reporting with Fast Updates

Optimal Planar Range Skyline Reporting with Linear Space in External Memory

Dynamic Planar Point Location in External Memory

Space Efficient Multi-Dimensional Range Reporting

Ranked Document Retrieval in External Memory

Range Partitioning Within Sublinear Time in the External Memory Model.

Output-sensitive Skyline Algorithms in External Memory

Orthogonal Point Location and Rectangle Stabbing Queries in 3-d

I/O-Efficient Dynamic Planar Range Skyline Queries

Orthogonal Range Searching on the RAM, Revisited

An External Memory Algorithm of Maxima-Finding Problems

External Memory Algorithms For Path Traversal in Graphs

Improved Time and Space Bounds for Dynamic Range Mode

An Optimal Algorithm for Range Search on Multidimensional Points

On Range Summary Queries

Efficient Top/bottom-K Fraction Estimation in Spatial Databases Using Bounded Main Memory

Enabling Structural Summaries for Efficient Update and Workload Adaptation

Data-Oblivious External-Memory Algorithms for the Compaction, Selection, and Sorting of Outsourced Data

External Topological Sorting In Large Graphs

I/O-Efficient Planar Range Skyline and Attrition Priority Queues