Abstract:We explore clustering problems in the streaming sliding window model in both general metric spaces and Euclidean space. We present the first polylogarithmic space $O(1)$-approximation to the metric $k$-median and metric $k$-means problems in the sliding window model, answering the main open problem posed by Babcock, Datar, Motwani and O'Callaghan, which has remained unanswered for over a decade. Our algorithm uses $O(k^3 \log^6 n)$ space and $\operatorname{poly}(k, \log n)$ update time. This is an exponential improvement on the space required by the technique due to Babcock, et al. We introduce a data structure that extends smooth histograms as introduced by Braverman and Ostrovsky to operate on a broader class of functions. In particular, we show that using only polylogarithmic space we can maintain a summary of the current window from which we can construct an $O(1)$-approximate clustering solution. Merge-and-reduce is a generic method in computational geometry for adapting offline algorithms to the insertion-only streaming model. Several well-known coreset constructions are maintainable in the insertion-only streaming model using this method, including well-known coreset techniques for the $k$-median, $k$-means in both low-and high-dimensional Euclidean spaces. Previous work has adapted these techniques to the insertion-deletion model, but translating them to the sliding window model has remained a challenge. We give the first algorithm that, given an insertion-only streaming coreset construction of space $s$, maintains a $(1\pm\epsilon)$-approximate coreset in the sliding window model using $O(s^2\epsilon^{-2}\log n)$ space. For clustering problems, our results constitute the first significant step towards resolving problem number 20 from the List of Open Problems in Sublinear Algorithms.

A New Streaming Data Cluster Algorithm Based on Sliding Window

Streaming data cluster algorithm based on sliding window

Optimal Algorithm of Data Streams Clustering on Sliding Window Model

A Framework for High-Quality Clustering Uncertain Data Stream over Sliding Windows.

Improved Data Stream Clustering Algorithm Based on Temporal Density Features

An Algorithm for Clustering Uncertain Data Streams over Sliding Windows

Tracking Clusters in Evolving Data Streams over Sliding Windows

XML Data Stream Clustering Algorithm Based on Sliding Window

Arbitrary Shape Clustering Algorithm for Evolving Data Stream over Sliding Windows

Clustering Algorithm for Ubiquitous Data Stream Mining Based on Slip Window

Density-Based Data Streams Subspace Clustering over Weighted Sliding Windows

Evolving data stream clustering algorithm based on the shared nearest neighbor density

An Algorithm For Clustering Xml Data Stream Using Sliding Window

Hcluwin: An Algorithm For Clustering Heterogeneous Data Streams Over Sliding Windows

Arbitrary Shape Cluster Algorithm for Clustering Data Stream

Efficient Data Stream Clustering Algorithm Based on k-Means Partitioning and Density

A Data Streams Clustering Algorithm Based On Interval Data

Incremental Subspace Clustering over Multiple Data Streams

Design and Implementation of Sliding Window with Circular Linked List for Dynamic Data Flow

Research on data stream clustering algorithms

A Unified Approach for Clustering Problems on Sliding Windows