Abstract:We consider online mining of correlated heavy-hitters from a data stream. Given a stream of two-dimensional data, a correlated aggregate query first extracts a substream by applying a predicate along a primary dimension, and then computes an aggregate along a secondary dimension. Prior work on identifying heavy-hitters in streams has almost exclusively focused on identifying heavy-hitters on a single dimensional stream, and these yield little insight into the properties of heavy-hitters along other dimensions. In typical applications however, an analyst is interested not only in identifying heavy-hitters, but also in understanding further properties such as: what other items appear frequently along with a heavy-hitter, or what is the frequency distribution of items that appear along with the heavy-hitters. We consider queries of the following form: In a stream S of (x, y) tuples, on the substream H of all x values that are heavy-hitters, maintain those y values that occur frequently with the x values in H. We call this problem as Correlated Heavy-Hitters (CHH). We formulate an approximate formulation of CHH identification, and present an algorithm for tracking CHHs on a data stream. The algorithm is easy to implement and uses workspace which is orders of magnitude smaller than the stream itself. We present provable guarantees on the maximum error, as well as detailed experimental results that demonstrate the space-accuracy trade-off.

Separator: Sifting Hierarchical Heavy Hitters Accurately from Data Streams

A New Algorithm for Mining Global Frequent Itemsets in a Stream.

Finding frequent items in data streams using hierarchical information.

Identifying Correlated Heavy-Hitters in a Two-Dimensional Data Stream

A New Algorithm of Mining High Utility Sequential Pattern in Streaming Data

Hids: A Multifunctional Generator Of Hierarchical Data Streams

DHS: Adaptive Memory Layout Organization of Sketch Slots for Fast and Accurate Data Stream Processing

DUET: A Generic Framework for Finding Special Quadratic Elements in Data Streams

Anomaly Detection in Hierarchical Data Streams under Unknown Models

Finding the Hottest Item in Data Streams

Efficient mining of concept-hierarchy aware distinguishing sequential patterns

A Unified Framework for Mining Batch and Periodic Batch in Data Streams

SSS: an Accurate and Fast Algorithm for Finding Top-k Hot Items in Data Streams

HClustream: A Novel Approach for Clustering Evolving Heterogeneous Data Stream

Efficient mining of skyline objects in subspaces over data streams

Learning-Based Heavy Hitters and Flow Frequency Estimation in Streams

HeavyCache: A Generic Sketch for Summarizing Data Streams

Finding Hierarchical Heavy Hitters In Network Measurement System

A Survey of High-utility Itemsets Mining

Streaming Hierarchical Clustering Based on Point-Set Kernel

Data Stream Mining Based on Time and Space Partitioning