Abstract:Frequent item mining, which deals with finding items that occur frequently in a given data stream over a period of time, is one of the heavily studied problems in data stream mining. A generalized version of frequent item mining is the persistent item mining, where a persistent item, unlike a frequent item, does not necessarily occur more frequently compared to other items over a short period of time, rather persists and occurs more frequently over a long period of time. To the best of our knowledge, there is no prior work on mining persistent items in a data stream. In this paper, we address the fundamental problem of finding persistent items in a given data stream during a given period of time at any given observation point. We propose a novel scheme, PIE, that can accurately identify each persistent item with a probability greater than any desired false negative rate (FNR) while using a very small amount of memory. The key idea of PIE is that it uses Raptor codes to encode the ID of each item that appears at the observation point during a measurement period and stores only a few bits of the encoded ID in the memory of that observation point during that measurement period. The item that is persistent occurs in enough measurement periods that enough encoded bits for the ID can be retrieved from the observation point to decode them correctly and get the ID of the persistent item. We implemented and extensively evaluated PIE using three real network traffic traces and compared its performance with two prior adapted schemes. Our results show that not only PIE achieves the desired FNR in every scenario, its FNR, on average, is 19.5 times smaller than the FNR of the best adapted prior art.

Mining Frequent Pattern Based On Fading Factor In Data Streams

Mining Fuzzy Association Rules in Data Streams

Approximate mining of global closed frequent itemsets over data streams

A New Algorithm for Mining Global Frequent Itemsets in a Stream.

A New Algorithm for Frequency Tendency Prediction over Data Streams

Efficient Discovery of Emerging Frequent Patterns in ArbitraryWindows on Data Streams

DELAY: A Lazy Approach for Mining Frequent Patterns over High Speed Data Streams

Estimation and maintenance of frequent pattern on data streams

State-of-the-art on Frequent Pattern Mining in Data Streams

Mining Frequent Itemsets Over Arbitrary Time Intervals in Data Streams

Discovering Significant Sequential Patterns in Data Stream by an Efficient Two-Phase Procedure

Frequent Items Mining Based on Weight in Data Stream

Survey of the Study on Frequent Pattern Mining in Data Streams

Mining Scalable Pattern Based on Temporal Logic over Data Streams

Fuzzy Frequent Pattern Mining Algorithm Based on Weighted Sliding Window and Type-2 Fuzzy Sets over Medical Data Stream

A Distributed Method for Fast Mining Frequent Patterns From Big Data

Efficient Mining of Closed Sequential Patterns on Stream Sliding Window

Finding Persistent Items in Data Streams

Efficient Algorithm for Mining of Frequent Itemsets over Uncertain Data Streams

Methods for Mining Frequent Items in Data Streams: an Overview

Mining Algorithm for Frequent Pattern in Data Stream Based on Stream-cube