Research on Fast Association Rule Mining Algorithm

GAO Jun,SHI Bai-Le

2005-01-01

Computer Science

Abstract:Based on fully analyzing the FP__growth, an association rule mining algorithm, this paper present a new as- sociation rule mining algorithm called MFP. The MFP algorithm can convert a transaction database into a MFP tree through scanning the database only once, and then do the mining of the tree.

What problem does this paper attempt to address?

A New Kind of Dynamic Association Rule and Its Mining Algorithms

SHEN Bin,YAO Min

DOI: https://doi.org/10.3321/j.issn:1001-0920.2009.09.006

2009-01-01

Abstract:In order to improve the shortcomings of the original dynamic association rule(DAR for short),this paper presents a new kind of DAR,which can reflect the dynamic information of rule with time better.Its defintions of support vector and confidence vector are accord with the classical defintions of support and confidence.Two new mining algorithms are also provided,which are ITS algorithm and EFP-growth algorithm.ITS algorithm has two stages,and can be well comprehended.EFP-growth algorithm is based on extended FP-tree and suitable for large volumes of data with high density.The experiment results show that the proposed algorithm has good performance and is fit for mining DARs.
Fuzzy Clustering-Based Quantitative Association Rules Mining in Multidimensional Data Set

Jining Jia,Yongzai Lu,Jian Chu,Hongye Su

DOI: https://doi.org/10.1007/978-3-319-20469-7_9

2015-01-01

Abstract:In order to solve the problem of mining quantitative association rules, an algorithm named Fuzzy Pattern Fusion based on Competitive Agglomeration (FPF-CA) is developed in this paper. The proposed algorithm is based on the superior functionalities of Fuzzy Pattern Fusion (FPF) for mining quantitative association rules and Competitive Agglomeration (CA) for finding the optimal number of clusters. The popular data set of UCI machine learning repository is used to demonstrate the feasibility of the FPF-CA algorithm. The simulation experiment results show that the proposed algorithm can efficiently mine quantitative association rules according to the actual data distribution.
An Improved Algorithm Based on FP-growth

郑斌,李涓子

DOI: https://doi.org/10.3969/j.issn.1674-7046.2008.04.004

2008-01-01

Abstract:Association rule mining has become an important and active research topic in the data mining due to its succinct,easy to be explained and understood. It has important theoretical value and the practical significance to study the association rules.After analyzing FP-growth association mining algorithm,this paper proposes an improved algorithm to overcome the low efficiency of FP-growth algorithm by adopting the projection method.The improved algorithm can directly obtain the condition pattern of frequent 1-item,thus it reduces the time cost of building the FP-tree in the FP-growth algorithm.It proved that the improvement algorithm has higher performance than original FP-tree algorithm.
Dtgc-Tree: A New Strategy Of Association Rules Mining

Jun-Bo Chen,Bo Zhou,Yiqun Ding,Lu Chen

DOI: https://doi.org/10.1109/ICMLC.2008.4620412

2008-01-01

Abstract:Efficient algorithms for mining frequent itemsets are crucial for mining association rules. As a condensed and complete representation of all the frequent itemsets, closed frequent itemsets mining has arisen a lot of interests in the data mining community. However, most of the studies haven't addressed the effects of noise in the data sets on the algorithms, and there has been limited attention to the development of noise tolerant algorithms.In this paper, we represent a noise tolerant algorithm, DTGC-Tree, which based on an intuitive idea: applying association rules as soon as possible. By this way, the new algorithm could prune a lot of duplicated closed itemsets in the transactional data base. The performance evaluation demonstrates that the proposed algorithm could stand against noise and is both time and space efficient.
A FP Growth Algorithm Based on MapReduce Model and It′s Application

Yuanbo LI,Zeyu SUN

DOI: https://doi.org/10.3969/i.issn.1674-5403.2016.04.015

2016-01-01

Abstract:FP-Growth is a classic association rule mining algorithm which is based on frequent pattern tree. It has the highly application in many areas. Focus on the problem of the traditional FP-growth algorithm may produce lots of frequent item sets. This essay proposes a strategy of item sets mergering and pruning which can improve the process mining on FP tree. Thus, analyzing the mining method of single path and multi-path can reduce the number of parts of mining branch. Then the improved FP-Growth algorithm parallelized, based on the MapReduce programming technology. The experimental results show the improved method has an advantage in executing efficiency and it has better acceleration ratio and scalability.
Research of Improved FP-Growth Algorithm in Association Rules Mining

Yi Zeng,Shiqun Yin,Jiangyue Liu,Miao Zhang

DOI: https://doi.org/10.1155/2015/910281

2015-01-01

Scientific Programming

Abstract:Association rules mining is an important technology in data mining. FP-Growth (frequent-pattern growth) algorithm is a classical algorithm in association rules mining. But the FP-Growth algorithm in mining needs two times to scan database, which reduces the efficiency of algorithm. Through the study of association rules mining and FP-Growth algorithm, we worked out improved algorithms of FP-Growth algorithm—Painting-Growth algorithm and N (not) Painting-Growth algorithm (removes the painting steps, and uses another way to achieve). We compared two kinds of improved algorithms with FP-Growth algorithm. Experimental results show that Painting-Growth algorithm is more than 1050 and N Painting-Growth algorithm is less than 10000 in data volume; the performance of the two kinds of improved algorithms is better than that of FP-Growth algorithm.

computer science, software engineering
An FP-tree construction algorithm based on exchanging nodes

NING Hui,CUI Li-gang,GUO Xiao-yu,WU Yue,FEI Jian-gang

DOI: https://doi.org/10.3969/j.issn.1009-671X.2010.05.010

2010-01-01

Abstract:FP-tree based FP-growth algorithm on association rule, which needs not to generate candidate itemset, is one of the data mining approaches widely applied in frequent item-set excavation. However, it still has disadvantages such as low running speed and more occupied resources when mining is performed in large datasets. To these problems it is found that the construction of FP-tree or condition FP-tree is performed in a stage occupying the most resources. To overcome these drawbacks, this paper proposes an improved FP-tree construction algorithm. On the one hand, it adopts node exchanging to reduce the scale of the tree and improve the mining efficiency. On the other hand, node exchanging condition is limited by threshold which is the difference of counters on node supporting degrees, which avoids unnecessary system spending due to excessive frequent exchanging. In this paper the FP-tree construction approach based on node exchanging is called TFP-tree algorithm. Experiment validation and performance analysis demonstrate that with a short running time and a great efficiency, the new approach is powerful.
An Improved FP-Growth Algorithm with Time Decay Factor and Element Attention Weight

Yan Xiao,Linghang Meng,Yiran Zhang,Yuantao Gu

DOI: https://doi.org/10.1109/icpeca60615.2024.10470947

2024-01-01

Abstract:Association rule mining (ARM) is an important data processing technique that can reveal potential correlations within data and extract valuable information. Nevertheless, the validity of information poses a challenge in the context of voluminous data. Acknowledging the prevalent focus on recent and specific elements in real-world scenarios. In this work we propose an improved association mining algorithm. First, based on the FP-Growth algorithm, a time decay factor is introduced to assign weights to transactions, reflecting their timeliness. Then, a weighting function is designed for the items of interest, significantly increasing their proportion in the frequent pattern mining outcomes. In addition, the FP-Growth structure is optimized to enhance the running efficiency. Experimental results demonstrate that the proposed algorithm performs well in variant ARM tasks by achieving several times faster running speed at the cost of a small amount of memory.
Effective Mining Algorithm of Association Rules Based on Benefit Measure

LIU Yuan,WU Yi-cai

DOI: https://doi.org/10.3785/j.issn.1008-973x.2007.06.008

2007-01-01

Abstract:In association rule mining,the traditional statistical measures,such as support and confidence,tend to generate too many spurious patterns,which cannot reflect user's requirement accurately.In order to solve this problem and obtain rule knowledge based on end users' real demand,this work proposed a new benefit measure according to the view of decision-making.The anti-monotony property about the new measure was proved,and the relationship and transforming method between constraint template and benefit measure were investigated.Moreover,an effective association rule mining algorithm PCBARM was presented.Experimental results showed the effectiveness of the benefit measure and the efficiency of PCBARM algorithm.The proposed measure not only can be used as a general realization algorithm for rule template but also provides more precise control.
AFOPT-tax: an Efficient Method for Mining Generalized Frequent Itemsets

Yu Xing Mao,Bai Le Shi

DOI: https://doi.org/10.1007/978-3-642-12145-6_9

2010-01-01

Abstract:The wide existence of taxonomic structures among the attributes of database makes mining generalized association rules an important task. Determining how to utilize the characteristics of the taxonomic structures to improve performance of mining generalized association rules is challenging work. This paper proposes a new algorithm called AFOPT-tax for mining generalized association rules. It projects the transaction database to a compact structure - ascending frequency ordered prefix tree (AFOPT) with a series of optimization, which reduces the high cost of database scan and frequent itemsets generation greatly. The experiments with synthetic datasets show that our method significantly outperforms both the classic Apriori based algorithms and the current FP-Growth based algorithms.
Association Rules Mining Of Silk Relics Database With The Rcfp-Growth Algorithm

Siying Dong,Meiqin Liu,Senlin Zhang

DOI: https://doi.org/10.23919/ChiCC.2019.8866658

2019-01-01

Abstract:The running speed of traditional auxiliary pattern design system which can extract association rules from silk relics database with Apriori algorithm is very low. In this paper, a rare common frequent pattern growth (RCFP-growth) algorithm is proposed to extract the association rules from silk relics database which has the obvious characteristics of imbalance, big data and specific mining target by the user in the auxiliary pattern design system. It contributes to the obvious reduction of the memory and time costs for association rules mining in the system compared to the Apriori algorithm and frequent pattern growth (FP-growth) algorithm. Some pattern designs with RCFP-growth algorithm are shown.
A Set Operation Based Algorithm for Association Rules Mining

铁治欣,陈奇,俞瑞钊

DOI: https://doi.org/10.3969/j.issn.1002-137X.2001.09.022

2001-01-01

Computer Science

Abstract:Mining association rules are an important data mining problem. In this paper ,an association rules mining algorithm,ARDBSO,which is based on set operation,is given. It can find all large itemsets in the database while only scan the database once. So,the time for I/O is reduced enormously and the efficiency of ARDBSO is improved. The experiments show that the efficiency of ARDBSO is 80～ 150times of Apriori's.
An Optimized Method for Mining Biological Data Multilevel Association Rules

Zhang Ping,Wang Yuesheng,Yang Guangxiao,Liu Dong,Xiao Qing,Yang Xi,Chang Junli,Chen Mingjie,He Guangyuan

DOI: https://doi.org/10.3969/j.issn.1002-5464.2007.02.026

2007-01-01

Abstract:Recent studies have proved that association rules can reveal the interactions between genes,but existing algorithms have some shortcomings.Improved from FP-Growth algorithm,MAGO-FP,a highly efficient data mining technique for discovering the multilevel association rules from biological data based on the concept hierarchy of Gene Ontology(GO)has been proposed.A data set of 300 expression profiles for yeast has been analyzed by the new algorithm,and some positive results are obtained.This algorithm can be used to analyze gene expression profiles and discover hidden multilevel association rules.
A Fast Algorithm for Mining Association Rules

Huang Liusheng,Chen Huaping,Wang Xun,Chen Guoliang

DOI: https://doi.org/10.1007/bf02948845

IF: 1.871

2000-01-01

Journal of Computer Science and Technology

Abstract:In this paper,the problem of discovering association rules between items in a large database of sales transactions is discussed.and a novel algorithm,BitMatrix,is proposed.The proposed algorithm is fundamentally different from the known algorithms Apriori and AprioriTid.Empirical evaluation shows that the algorithm outperforms the known ones for large databases.Scale-up experiments show that the algorithm scales linearly with the number of transactions.
A Fast Algorithm for Maintenance of Association Rules in Incremental Databases

Xin Li,Zhi-Hong Deng,Shiwei Tang

DOI: https://doi.org/10.1007/11811305_5

2006-01-01

Abstract:In this paper, we propose an algorithm for maintaining the frequent itemsets discovered in a database with minimal re-computation when new transactions are added to or old transactions are removed from the transaction database. An efficient algorithm called EFPIM (Extending FP-tree for Incremental Mining), is designed based on EFP-tree (extended FP-tree) structures. An important feature of our algorithm is that it requires no scan of the original database, and the new EFP-tree structure of the updated database can be obtained directly from the EFP-tree of the original database. We give two versions of EFPIM algorithm, called EFPIM1 (an easy vision to implement) and EFPIM2 (a fast algorithm), they both mining frequent itemsets of the updated database based on EFP-tree. Experimental results show that EFPIM outperforms the existing algorithms in terms of the execution time.
Interactive association rules mining based on FP-Tree and its application in education management

Huang Tao,Jiang Hao,Pu An-jian

2009-01-01

Abstract:This paper discuss how to converge to the interesting rules when user adjusts the minimum support and the minimum confidence threshold, and how to make use of former FP-tree to speed up the FP-Growth procedure, thereby, converge at interesting rules for user quickly, and proposes an interest measurement criterion based on probability difference. In the end, it's applied into data mining for education management of southeast university successfully
FP-tree and COFI Based Approach for Mining of Multiple Level Association Rules in Large Databases

Virendra Kumar Shrivastava,Parveen Kumar,K. R. Pardasani

DOI: https://doi.org/10.3850/978-981-08-7300-4_0634

2010-03-09

Abstract:In recent years, discovery of association rules among itemsets in a large database has been described as an important database-mining problem. The problem of discovering association rules has received considerable research attention and several algorithms for mining frequent itemsets have been developed. Many algorithms have been proposed to discover rules at single concept level. However, mining association rules at multiple concept levels may lead to the discovery of more specific and concrete knowledge from data. The discovery of multiple level association rules is very much useful in many applications. In most of the studies for multiple level association rule mining, the database is scanned repeatedly which affects the efficiency of mining process. In this research paper, a new method for discovering multilevel association rules is proposed. It is based on FP-tree structure and uses cooccurrence frequent item tree to find frequent items in multilevel concept hierarchy.

Other Computer Science
Improvement on Algorithm FP-Growth and Applications in Its E-Commerce

罗建,李艳梅

DOI: https://doi.org/10.3969/j.issn.1673-5072.2010.03.017

2010-01-01

Abstract:This paper analyzes the FP-Growth association rule mining algorithms,and improves the algorithm to control the mass of data mining in the recursive depth.At the same time,combined with the level of mining technology,we apply the improved algorithm to the field of B2C e-commerce and use Java technology to design the goods mining system.Through a combination of a large e-commerce site's actual transaction data for correlation analysis,we have achieved the result of the association rules by mining transaction data at a reasonable time frame.
Efficient Method for Mining Multiple-Level and Generalized Association Rules

MAO Yu-Xing,CHEN Tong-Bing,SHI Bai-Le

DOI: https://doi.org/10.3724/sp.j.1001.2011.03907

2011-01-01

Abstract:This paper proposes a idea for mining multiple-level and generalized association rules.First,an item correlation model is set up,based on the domain knowledge and clusters the items according to their correlation.Secondly,the transaction database,based on the item clusters,are reduced which make the transaction database smaller.Finally,the partitioned transaction databases are projected onto a compact structure called AFOPT-tree and find the frequent itemsets from the AFOPT.Based on the proposed idea,this paper proposes a top-down algorithm TD-CBP-MLARM and a bottom-up algorithm BU-CBP-MLARM to mine the multiple-level association rules.Additionally,this paper extends the idea to a generalized mining association rule and gives a new efficient algorithm CBP-GARM.The experiments show that the proposed algorithms not only corrects and completes mining results,but also outperform the well-known and current algorithms in mining effectiveness.
Fast Top-K association rule mining using rule generation property pruning

Xiangyu Liu,Xinzheng Niu,Philippe Fournier-Viger

DOI: https://doi.org/10.1007/s10489-020-01994-9

IF: 5.3

2020-10-26

Applied Intelligence

Abstract:Traditional association rule mining algorithms can have a long runtime, high memory consumption, and generate a huge number of rules. Browsing through numerous rules and adjusting parameters to find just enough rules is a tedious task for users, who are often only interested in finding the strongest rules. Hence, many recent studies have focused on mining the top-k most frequent association rules that have a minimum confidence so as to limit the number of rules by ranking them by frequency. Though this redefined task has many applications, the performance of current algorithms remains an issue. To address this issue, this paper presents a novel algorithm named FTARM (Fast Top-K Association Rule Miner) to efficiently find the set of top-k association rules using a novel technique called Rule Generation Property Pruning (RGPP). This technique reduces the search space by analyzing the internal relationships between items of the database to be mined and the parameters set by users. Furthermore, a novel candidate pruning property is used by this technique to speed up the mining process. FTARM’s efficiency was evaluated on various public benchmark datasets. A substantial reduction of the association rule mining time and memory usage was observed, and that FTARM has good scalability, which can benefit to many applications.

computer science, artificial intelligence

Research on Fast Association Rule Mining Algorithm

A New Kind of Dynamic Association Rule and Its Mining Algorithms

Fuzzy Clustering-Based Quantitative Association Rules Mining in Multidimensional Data Set

An Improved Algorithm Based on FP-growth

Dtgc-Tree: A New Strategy Of Association Rules Mining

A FP Growth Algorithm Based on MapReduce Model and It′s Application

Research of Improved FP-Growth Algorithm in Association Rules Mining

An FP-tree construction algorithm based on exchanging nodes

An Improved FP-Growth Algorithm with Time Decay Factor and Element Attention Weight

Effective Mining Algorithm of Association Rules Based on Benefit Measure

AFOPT-tax: an Efficient Method for Mining Generalized Frequent Itemsets

Association Rules Mining Of Silk Relics Database With The Rcfp-Growth Algorithm

A Set Operation Based Algorithm for Association Rules Mining

An Optimized Method for Mining Biological Data Multilevel Association Rules

A Fast Algorithm for Mining Association Rules

A Fast Algorithm for Maintenance of Association Rules in Incremental Databases

Interactive association rules mining based on FP-Tree and its application in education management

FP-tree and COFI Based Approach for Mining of Multiple Level Association Rules in Large Databases

Improvement on Algorithm FP-Growth and Applications in Its E-Commerce

Efficient Method for Mining Multiple-Level and Generalized Association Rules

Fast Top-K association rule mining using rule generation property pruning