Abstract:Frequent itemset mining (FIM) is a significant data mining technique which is widely adopted in numerous applications for exploring frequent items. With the rapid growth and expansion of datasets, FIM has become an interesting topic for many researchers, which has triggered many innovations of numerous FIM algorithms in the big data environment. This study aims to design an optimization parallel frequent itemset mining algorithm based on MapReduce, named as \({\text{PFIMD}}\) algorithm, to deal with the problem of time and space complexity during processing and computing item sets, as well as the failure to adequately balance the load among parallel tasks in the existing parallel FIM algorithms. First, a structure called \({\text{DiffNodeset}}\) is adopted for avoiding the increase of \(N{-}list\) cardinality in the \({\text{MRPrePost}}\) algorithm effectively. Then, a 2-way comparison strategy is designed to speed up the \({\text{DiffNodeset}}\) generation of 2-itemsets and reduce the time complexity of the algorithm. Finally, the steps of the improved algorithm are parallelized using the cloud computing platform Hadoop and the programming model MapReduce. Moreover, to achieve a uniform grouping of each item in \(F{-}list\), a load balancing strategy based on dynamic grouping is proposed, which solves the problem of uneven load of each node in the cluster. The experimental results show that the modified algorithm not only overcomes the shortcoming of \({\text{MRPrePost}}\) in the big data environment, but also greatly reduces the time and space complexity. Finally, the specific applications of \({\text{PFIMD}}\) algorithm in several multimedia data sets are listed to illustrate its universality.

Parallel mining of time-faded heavy hitters

Distributed mining of time--faded heavy hitters

A GPU-based Parallel Algorithm for Time Series Pattern Mining

A STABLE PARALLEL DISTRIBUTED FREQUENT ITEMSET MINING ALGORITHM AND ITS APPLICATION

Parallel Algorithms of Mining Frequent Patterns from Sparse Data Source

A Stack-Centric Processing Model for Iterative Processing

Novel Frequent Pattern Mining Algorithm Based on Parallelization Scheme

Cmfsm: a Scalable CPU-MIC Coordinated Drug-Finding Tool by Frequent Subgraph Mining

Accelerated Frequent Closed Sequential Pattern Mining for Uncertain Data

A Scalable CPU-MIC Coordinated Drug-Finding Tool by Frequent Subgraph Mining

Study on Distributed Sequential Pattern Discovery Algorithm

An Improved Parallel Algorithm For Sequence Mining

PFIMD: a parallel MapReduce-based algorithm for frequent itemset mining

A Parallel Algorithm for Graph Transaction Based Frequent Subgraph Mining

Parallel Frequent Pattern Discovery: Challenges and Methodology

Fast and Accurate Mining of Correlated Heavy Hitters

Graph-Based Substructure Pattern Mining Using CUDA Dynamic Parallelism.

A Parallel Approach For Frequent Subgraph Mining In A Single Large Graph Using Spark

Parallel Mining of Closed Quasi-Cliques

Improved Algorithm for Parallel Mining Collaborative Frequent Itemsets in Multiple Data Streams

Parallel Strong Connectivity Based on Faster Reachability