Abstract:As we are mining streaming data using frequent pattern, the accumulation of time is a huge factor in influencing the relationship between data items. In this case, how to keep track of the historical information of streaming data efficiently and design a temporal frequent measurement which considers time accumulation are two critical problems of frequent pattern for mining streaming data. As a result, we bring out a scheme of incremental temporal frequent pattern mining based on spark streaming framework. More specifically, as for the time property of streaming data, we design a calculating approach of temporal frequency which could decay and increase along with time. Simultaneously, as for the property of information accumulation, we put forward the ITFP (Incremental Temporal Frequent Pattern mining) algorithm. In order to minimize the spatial cost of recording historical information, this algorithm draws into TFP-tree (Time Frequent Pattern tree) to save historical frequent patterns, and reconstructs TFP-tree to achieve incremental mining. Additionally, a temporal sub-frequent pattern is proposed as backtracking window of historical information to reduce the deviation of frequent pattern. Finally, we test and verify above mentioned approaches through using public paper data set. And the experimental results show that the ITFP mining based on spark streaming has better performance of accuracy and validity, and even better extendibility under the distributed circumstance.

Incremental Temporal Frequent Pattern Mining Based on Spark Streaming

Approximate mining of global closed frequent itemsets over data streams

Mining Fuzzy Association Rules in Data Streams

A New Algorithm for Frequency Tendency Prediction over Data Streams

Mining Spread Patterns of Spatio-temporal Co-occurrences over Zones

Mining Scalable Pattern Based on Temporal Logic over Data Streams

State-of-the-art on Frequent Pattern Mining in Data Streams

Efficient Discovery of Emerging Frequent Patterns in ArbitraryWindows on Data Streams

Estimation and maintenance of frequent pattern on data streams

Mining Frequent Itemsets Over Arbitrary Time Intervals in Data Streams

Efficient Incremental Maintenance of Frequent Patterns with FP-tree

Incremental frequent itemsets mining based on frequent pattern tree and multi-scale

SWEclat: a frequent itemset mining algorithm over streaming data using Spark Streaming

Incremental frequent tree-structured pattern mining from semi-structured data

DELAY: A Lazy Approach for Mining Frequent Patterns over High Speed Data Streams

Data analysis in real-time supply chain based on frequent pattern mining

Survey of the Study on Frequent Pattern Mining in Data Streams

Mining Method of Frequent Patterns Based on Temporal Constraints

Continually Evaluating Similarity-Based Pattern Queries on a Streaming Time Series

Discovering Significant Sequential Patterns in Data Stream by an Efficient Two-Phase Procedure

Fuzzy Frequent Pattern Mining Algorithm Based on Weighted Sliding Window and Type-2 Fuzzy Sets over Medical Data Stream