Abstract:As we are mining streaming data using frequent pattern, the accumulation of time is a huge factor in influencing the relationship between data items. In this case, how to keep track of the historical information of streaming data efficiently and design a temporal frequent measurement which considers time accumulation are two critical problems of frequent pattern for mining streaming data. As a result, we bring out a scheme of incremental temporal frequent pattern mining based on spark streaming framework. More specifically, as for the time property of streaming data, we design a calculating approach of temporal frequency which could decay and increase along with time. Simultaneously, as for the property of information accumulation, we put forward the ITFP (Incremental Temporal Frequent Pattern mining) algorithm. In order to minimize the spatial cost of recording historical information, this algorithm draws into TFP-tree (Time Frequent Pattern tree) to save historical frequent patterns, and reconstructs TFP-tree to achieve incremental mining. Additionally, a temporal sub-frequent pattern is proposed as backtracking window of historical information to reduce the deviation of frequent pattern. Finally, we test and verify above mentioned approaches through using public paper data set. And the experimental results show that the ITFP mining based on spark streaming has better performance of accuracy and validity, and even better extendibility under the distributed circumstance.

RFIMiner: A regression-based algorithm for recently frequent patterns in multiple time granularity data streams

Approximate mining of global closed frequent itemsets over data streams

Mining Fuzzy Association Rules in Data Streams

Mining Frequent Pattern Based On Fading Factor In Data Streams

Mining recent frequent itemsets in data streams by radioactively attenuating strategy

F-RFM-Miner: an Efficient Algorithm for Mining Fuzzy Patterns Using the Recency-Frequency-monetary Model

Incremental Temporal Frequent Pattern Mining Based on Spark Streaming

Suffixminer: Efficiently Mining Frequent Itemsets In Data Streams By Suffix-Forest

Efficient Discovery of Emerging Frequent Patterns in ArbitraryWindows on Data Streams

DELAY: A Lazy Approach for Mining Frequent Patterns over High Speed Data Streams

Mining frequent patterns in data stream over sliding windows

Frequent Items Mining Based on Weight in Data Stream

Mining Frequent Itemsets Over Arbitrary Time Intervals in Data Streams

Stable Periodic Frequent Itemset Mining on Uncertain Datasets

A Mining Maximal Frequent Itemsets over the Entire History of Data Streams

Data analysis in real-time supply chain based on frequent pattern mining

Estimation and maintenance of frequent pattern on data streams

Considering RFM-values of Frequent Patterns in Transactional Databases

Efficient Incremental Maintenance of Frequent Patterns with FP-tree

Efficient Algorithm for Mining of Frequent Itemsets over Uncertain Data Streams

MFIS—Mining Frequent Itemsets on Data Streams