Abstract:Mining frequent itemsets from transactional data streams is challenging due to the nature of the exponential explosion of itemsets and the limit memory space required for mining frequent itemsets. Given a domain of I unique items, the possible number of itemsets can be up to 2I−1. When the length of data streams approaches to a very large number N, the possibility of an itemset to be frequent becomes larger and difficult to track with limited memory. The existing studies on finding frequent items from high speed data streams are false-positive oriented. That is, they control memory consumption in the counting processes by an error parameter ϵ, and allow items with support below the specified minimum support s but above s−ϵ counted as frequent ones. However, such false-positive oriented approaches cannot be effectively applied to frequent itemsets mining for two reasons. First, false-positive items found increase the number of false-positive frequent itemsets exponentially. Second, minimization of the number of false-positive items found, by using a small ϵ, will make memory consumption large. Therefore, such approaches may make the problem computationally intractable with bounded memory consumption. In this paper, we developed algorithms that can effectively mine frequent item(set)s from high speed transactional data streams with a bound of memory consumption. Our algorithms are based on Chernoff bound in which we use a running error parameter to prune item(set)s and use a reliability parameter to control memory. While our algorithms are false-negative oriented, that is, certain frequent itemsets may not appear in the results, the number of false-negative itemsets can be controlled by a predefined parameter so that desired recall rate of frequent itemsets can be guaranteed. Our extensive experimental studies show that the proposed algorithms have high accuracy, require less memory, and consume less CPU time. They significantly outperform the existing false-positive algorithms.

Dynamically Maintaining Frequent Items over a Data Stream

A New Algorithm for Mining Global Frequent Itemsets in a Stream.

Approximate mining of global closed frequent itemsets over data streams

Finding Frequent Items in Time Decayed Data Streams.

Frequent Items Mining Based on Weight in Data Stream

Novel structures for counting frequent items in time decayed streams

Finding Recently Frequent Item in Distributed Data Stream

Histogram Data Streams with Fast Incremental Maintenance

Approach to determine Frequent Items Dynamically

Finding needles in a hay stream: On persistent item lookup in data streams

An Efficient Algorithm for Maintaining Frequent Closed Itemsets over Data Stream.

Web Technologies and Applications

DELAY: A Lazy Approach for Mining Frequent Patterns over High Speed Data Streams

Error-adaptive and time-aware maintenance of frequency counts over data streams

Mining pattern from stream data based on counting

Estimation and maintenance of frequent pattern on data streams

False Positive or False Negative: Mining Frequent Itemsets from High Speed Transactional Data Streams.

Counting Evolving Data Stream Based on Hierarchical Counting Bloom Filter

Adaptive algorithm of histogram maintain in data stream processing

Finding Significant Items in Data Streams.

A False Negative Approach to Mining Frequent Itemsets from High Speed Transactional Data Streams