Abstract:Frequent itemset mining (FIM) is a significant data mining technique which is widely adopted in numerous applications for exploring frequent items. With the rapid growth and expansion of datasets, FIM has become an interesting topic for many researchers, which has triggered many innovations of numerous FIM algorithms in the big data environment. This study aims to design an optimization parallel frequent itemset mining algorithm based on MapReduce, named as \({\text{PFIMD}}\) algorithm, to deal with the problem of time and space complexity during processing and computing item sets, as well as the failure to adequately balance the load among parallel tasks in the existing parallel FIM algorithms. First, a structure called \({\text{DiffNodeset}}\) is adopted for avoiding the increase of \(N{-}list\) cardinality in the \({\text{MRPrePost}}\) algorithm effectively. Then, a 2-way comparison strategy is designed to speed up the \({\text{DiffNodeset}}\) generation of 2-itemsets and reduce the time complexity of the algorithm. Finally, the steps of the improved algorithm are parallelized using the cloud computing platform Hadoop and the programming model MapReduce. Moreover, to achieve a uniform grouping of each item in \(F{-}list\), a load balancing strategy based on dynamic grouping is proposed, which solves the problem of uneven load of each node in the cluster. The experimental results show that the modified algorithm not only overcomes the shortcoming of \({\text{MRPrePost}}\) in the big data environment, but also greatly reduces the time and space complexity. Finally, the specific applications of \({\text{PFIMD}}\) algorithm in several multimedia data sets are listed to illustrate its universality.

MRFP: Discovery Frequent Patterns Using MapReduce Frequent Pattern Growth

An Enhanced Frequent Pattern Growth Based on MapReduce for Mining Association Rules

A FP Growth Algorithm Based on MapReduce Model and It′s Application

MapReduce Frequent Itemsets for Mining Association Rules

A New Algorithm for Mining Multiple-Level Frequent Patterns

Balanced Parallel FP-Growth with MapReduce

Algorithm for Frequent Pattern Mining Based on FP-Reference-Tree/List

A Pattern Growth Algorithm for Frequent Patterns Mining

A Distributed Method for Fast Mining Frequent Patterns From Big Data

A Two-Phase Approach for Unexpected Pattern Mining.

JPMiner: Mining Frequent Jump Patterns from Graph Databases.

Mining Frequent Pattern Using Item-Transformation Method

Efficient Incremental Maintenance of Frequent Patterns with FP-tree

Towards Efficient Re-mining of Frequent Patterns Upon Threshold Changes

Mop: an Efficient Algorithm for Mining Frequent Pattern with Subtree Traversing

PFIMD: a parallel MapReduce-based algorithm for frequent itemset mining

Fast Algorithm for Discovering Maximum Frequent Pattern

Association Rules Mining Of Silk Relics Database With The Rcfp-Growth Algorithm

A Novel Approach for Fast Mining Frequent Itemsets Use N-list Structure Based on MapReduce.

Pfp: Parallel Fp-Growth For Query Recommendation

Mining Top-Rank-K Frequent Patterns