Abstract:Mining frequent itemsets from transactional data streams is challenging due to the nature of the exponential explosion of itemsets and the limit memory space required for mining frequent itemsets. Given a domain of I unique items, the possible number of itemsets can be up to 2I−1. When the length of data streams approaches to a very large number N, the possibility of an itemset to be frequent becomes larger and difficult to track with limited memory. The existing studies on finding frequent items from high speed data streams are false-positive oriented. That is, they control memory consumption in the counting processes by an error parameter ϵ, and allow items with support below the specified minimum support s but above s−ϵ counted as frequent ones. However, such false-positive oriented approaches cannot be effectively applied to frequent itemsets mining for two reasons. First, false-positive items found increase the number of false-positive frequent itemsets exponentially. Second, minimization of the number of false-positive items found, by using a small ϵ, will make memory consumption large. Therefore, such approaches may make the problem computationally intractable with bounded memory consumption. In this paper, we developed algorithms that can effectively mine frequent item(set)s from high speed transactional data streams with a bound of memory consumption. Our algorithms are based on Chernoff bound in which we use a running error parameter to prune item(set)s and use a reliability parameter to control memory. While our algorithms are false-negative oriented, that is, certain frequent itemsets may not appear in the results, the number of false-negative itemsets can be controlled by a predefined parameter so that desired recall rate of frequent itemsets can be guaranteed. Our extensive experimental studies show that the proposed algorithms have high accuracy, require less memory, and consume less CPU time. They significantly outperform the existing false-positive algorithms.

Finding Significant Items in Data Streams.

LTC: A Fast Algorithm to Accurately Find Significant Items in Data Streams

SSS: an Accurate and Fast Algorithm for Finding Top-k Hot Items in Data Streams

Frequent Items Mining Based on Weight in Data Stream

Local Differentially Private Heavy Hitter Detection in Data Streams with Bounded Memory

WavingSketch: An Unbiased and Generic Sketch for Finding Top-k Items in Data Streams

Finding Persistent Items in Data Streams

False Positive or False Negative: Mining Frequent Itemsets from High Speed Transactional Data Streams.

Finding frequent items in data streams using hierarchical information.

Finding Frequent Items in Time Decayed Data Streams.

Finding needles in a hay stream: On persistent item lookup in data streams

A False Negative Approach to Mining Frequent Itemsets from High Speed Transactional Data Streams

Identifying the Most Recent Heavy Hitters in Large-Scale Streams Using Block-wise Counting

Novel structures for counting frequent items in time decayed streams

Finding the Hottest Item in Data Streams

DELAY: A Lazy Approach for Mining Frequent Patterns over High Speed Data Streams

Fine-grained Probability Counting for Cardinality Estimation of Data Streams.

An Algorithm of Mining Frequent Itemsets Based on Bloom Filter

Scalable KDE-based Top-N Local Outlier Detection over Large-Scale Data Streams

An efficient algorithm for frequent itemset mining on data streams

Bubble Sketch: A High-performance and Memory-efficient Sketch for Finding Top- K Items in Data Streams