Abstract:We explore clustering problems in the streaming sliding window model in both general metric spaces and Euclidean space. We present the first polylogarithmic space $O(1)$-approximation to the metric $k$-median and metric $k$-means problems in the sliding window model, answering the main open problem posed by Babcock, Datar, Motwani and O'Callaghan, which has remained unanswered for over a decade. Our algorithm uses $O(k^3 \log^6 n)$ space and $\operatorname{poly}(k, \log n)$ update time. This is an exponential improvement on the space required by the technique due to Babcock, et al. We introduce a data structure that extends smooth histograms as introduced by Braverman and Ostrovsky to operate on a broader class of functions. In particular, we show that using only polylogarithmic space we can maintain a summary of the current window from which we can construct an $O(1)$-approximate clustering solution. Merge-and-reduce is a generic method in computational geometry for adapting offline algorithms to the insertion-only streaming model. Several well-known coreset constructions are maintainable in the insertion-only streaming model using this method, including well-known coreset techniques for the $k$-median, $k$-means in both low-and high-dimensional Euclidean spaces. Previous work has adapted these techniques to the insertion-deletion model, but translating them to the sliding window model has remained a challenge. We give the first algorithm that, given an insertion-only streaming coreset construction of space $s$, maintains a $(1\pm\epsilon)$-approximate coreset in the sliding window model using $O(s^2\epsilon^{-2}\log n)$ space. For clustering problems, our results constitute the first significant step towards resolving problem number 20 from the List of Open Problems in Sublinear Algorithms.

Space Efficient Quantile Summary for Constrained Sliding Windows on a Data Stream

Continuously Maintaining Quantile Summaries of the Most Recent N Elements over a Data Stream

Approximate Processing of Massive Continuous Quantile Queries over High-Speed Data Streams

Construction of summary structures from sliding windows over data streams

New Sampling-Based Summary Structures for Sliding Windows over Data Streams

Sliding-window Top-K Queries on Uncertain Streams

Construction of synopsis for periodically updating sliding windows over data streams

Interval Selection in Sliding Windows

A Basic-Window Based Priority-Sample Algorithm For Sliding Windows Over Data Streams

Optimal Quantile Approximation in Streams

A Fast Algorithm for Approximate Quantiles in High Speed Data Streams

Density-Based Data Streams Subspace Clustering over Weighted Sliding Windows

A Unified Approach for Clustering Problems on Sliding Windows

Effective Space Usage Estimation for Sliding-Window Skybands

Sliding-Window Probabilistic Threshold Aggregate Queries on Uncertain Data Streams

Space-efficient Relative Error Order Sketch over Data Streams

Continuous Monitoring of Distributed Data Streams over a Time-Based Sliding Window

An Algorithm for Multi-Extreme Queries on Sliding Windows

A Priority Random Sampling Algorithm For Time-Based Sliding Windows Over Weighted Streaming Data

Semantic Load Shedding for Sliding Window Join-Aggregation Queries over Data Streams

A Learned Cuckoo Filter for Approximate Membership Queries over Variable-sized Sliding Windows on Data Streams.