Algorithm for mining frequent patterns based on converse FP-tree

Yan-duo ZHAO,Bin-heng SONG

2005-01-01

Abstract:It proposed an algorithm for mining frequent patterns by finding the frequent extensions and merging sub-trees in a conversely constructed FP-tree. The performance of the algorithm is superior to the one of FP-Growth both in time and space consuming. It runs over two times faster than the FP-Growth and has a good scalability.

What problem does this paper attempt to address?

Mining Frequent Patterns with the Pattern Tree.

Hao Huang,Xindong Wu,Richard Relue

DOI: https://doi.org/10.1007/bf03037636

2005-01-01

New Generation Computing

Abstract:Mining frequent patterns with a frequent pattern tree (FP-tree in short) avoids costly candidate generation and repeatedly occurrence frequency checking against the support threshold. It therefore achieves much better performance and efficiency than Apriori-like algorithms. However, the database still needs to be scanned twice to get the FP-tree. This can be very time-consuming when new data is added to an existing database because two scans may be needed for not only the new data but also the existing data. In this research we propose a new data structure, the pattern tree (P-tree in short), and a new technique, which can get the P-tree through only one scan of the database and can obtain the corresponding FP-tree with a specified support threshold. Updating a P-tree with new data needs one scan of the new data only, and the existing data does not need to be re-scanned. Our experiments show that the P-tree method outperforms the FP-tree method by a factor up to an order of magnitude in large datasets.
Algorithm for Frequent Pattern Mining Based on FP-Reference-Tree/List

SHI Wei,FU Yan

DOI: https://doi.org/10.3969/j.issn.1002-137x.2006.06.057

2006-01-01

Computer Science

Abstract:In order to resolve frequent pattern mining problem efficiently, redundant operation and temporary data in FP-growth algorithm are analyzed, data structure FPR-tree and FPR-list are imported, the method of conditional pattern base generation and storage in FP-growth algorithm are improved, and a new FPRSG algorithm is presented. Theoretical analysis and experiment result both show that FPRSG is more efficient than FP-growth.
An FP-tree construction algorithm based on exchanging nodes

NING Hui,CUI Li-gang,GUO Xiao-yu,WU Yue,FEI Jian-gang

DOI: https://doi.org/10.3969/j.issn.1009-671X.2010.05.010

2010-01-01

Abstract:FP-tree based FP-growth algorithm on association rule, which needs not to generate candidate itemset, is one of the data mining approaches widely applied in frequent item-set excavation. However, it still has disadvantages such as low running speed and more occupied resources when mining is performed in large datasets. To these problems it is found that the construction of FP-tree or condition FP-tree is performed in a stage occupying the most resources. To overcome these drawbacks, this paper proposes an improved FP-tree construction algorithm. On the one hand, it adopts node exchanging to reduce the scale of the tree and improve the mining efficiency. On the other hand, node exchanging condition is limited by threshold which is the difference of counters on node supporting degrees, which avoids unnecessary system spending due to excessive frequent exchanging. In this paper the FP-tree construction approach based on node exchanging is called TFP-tree algorithm. Experiment validation and performance analysis demonstrate that with a short running time and a great efficiency, the new approach is powerful.
A Novel Algorithm of Mining Maximal Frequent Pattern Based on Projection Sum Tree

Chuanyao Yang,Yuqin Li,Chenghong Zhang,Yunfa Hu

DOI: https://doi.org/10.1109/FSKD.2007.95

2007-01-01

Abstract:In this paper, a novel algorithm for mining maximal frequent patterns is proposed based on projection sum frequent items tree. This algorithm projects the transaction base into a projection sum tree and it can store the frequent itemsets in the tree in a compact manner. The algorithm builds frequent patterns tree directly as FPMax algorithm does. However, all the nodes of PSFIT are sorted and ordered, the children of which are also sorted and ordered. It doesn 't need to generate conditional FP-tree dynamically and recursively and it can take advantage of computational result that has been done. The experiment shows that PSFIT is an efficient algorithm, it has comparable performance with FPMax, and in most cases it outperforms FPMax.
A New Algorithm for Mining Multiple-Level Frequent Patterns

孟凡荣,宋春景,张磊

DOI: https://doi.org/10.3969/j.issn.1008-0570.2009.03.073

2009-01-01

Abstract:With the combination of mapping and parallel techniques, the algorithm FP-growth is extended to the discovery of the multiple-level frequent patterns. And then a new algorithm is developed, which is called multiple-level mapping frequent patterns growth algorithm, namely ML_MFP_Growth. In the process of mining, firstly the transaction database is dealt with to get an encoded database; secondly each row of the encoded database is mapped to construct the MFP-Tree at all concept levels; finally each MFPTree is mined in parallel to generate all the frequent patterns. Finally a performance test is held, which shows that the ML_MFP_Growth algorithm has better performance than some traditional algorithms.
A FP Growth Algorithm Based on MapReduce Model and It′s Application

Yuanbo LI,Zeyu SUN

DOI: https://doi.org/10.3969/i.issn.1674-5403.2016.04.015

2016-01-01

Abstract:FP-Growth is a classic association rule mining algorithm which is based on frequent pattern tree. It has the highly application in many areas. Focus on the problem of the traditional FP-growth algorithm may produce lots of frequent item sets. This essay proposes a strategy of item sets mergering and pruning which can improve the process mining on FP tree. Thus, analyzing the mining method of single path and multi-path can reduce the number of parts of mining branch. Then the improved FP-Growth algorithm parallelized, based on the MapReduce programming technology. The experimental results show the improved method has an advantage in executing efficiency and it has better acceleration ratio and scalability.
Dtgc-Tree: A New Strategy Of Association Rules Mining

Jun-Bo Chen,Bo Zhou,Yiqun Ding,Lu Chen

DOI: https://doi.org/10.1109/ICMLC.2008.4620412

2008-01-01

Abstract:Efficient algorithms for mining frequent itemsets are crucial for mining association rules. As a condensed and complete representation of all the frequent itemsets, closed frequent itemsets mining has arisen a lot of interests in the data mining community. However, most of the studies haven't addressed the effects of noise in the data sets on the algorithms, and there has been limited attention to the development of noise tolerant algorithms.In this paper, we represent a noise tolerant algorithm, DTGC-Tree, which based on an intuitive idea: applying association rules as soon as possible. By this way, the new algorithm could prune a lot of duplicated closed itemsets in the transactional data base. The performance evaluation demonstrates that the proposed algorithm could stand against noise and is both time and space efficient.
Mining Frequent Induced Subtree Patterns with Subtree-Constraint

Lei Zou,Yansheng Lu,Huaming Zhang,Rong Hu

DOI: https://doi.org/10.1109/ICDMW.2006.112

2006-01-01

Abstract:Mining frequent induced subtree patterns is very useful in domains such as XML databases, web log analyzing. However, because of the combinatorial explosion, mining all frequent subtree patterns becomes infeasible for a large and dense tree database. And too many frequent subtree patterns also confuse users. Usually only a small set of the mining results can arouse users' interests. In this paper, we propose a problem to discover frequent induced subtree patterns that are super trees of a given pattern tree specified by users, i.e. frequent induced subtree patterns with subtree-constraint. Most existing frequent subtree mining algorithms are based on right-most extension, which does not work well in the new problem. So free extension is presented to replace right-most extension in this paper. To avoid the duplicate pattern problem caused by free extension, we develop an efficient method that ensures no duplicate patterns in mining process or results. Then Subtree- Constraint Frequent Subtree Patterns Mining Algorithm, i.e.SCFS algorithm, is given. The experiment results also show that our algorithm achieves good performance.
Efficient Pattern-Growth Methods for Frequent Tree Pattern Mining

Chen Wang,Mingsheng Hong,Jian Pei,Haofeng Zhou,Wei Wang,Baile Shi

DOI: https://doi.org/10.1007/978-3-540-24775-3_54

2004-01-01

Abstract:Mining frequent tree patterns is an important research problems with broad applications in bioinformatics, digital library, e-commerce, and so on. Previous studies highly suggested that pattern-growth methods are efficient in frequent pattern mining. In this paper, we systematically develop the pattern growth methods for mining frequent tree patterns. Two algorithms, Chopper and XSpanner, are devised. An extensive performance study shows that the two newly developed algorithms outperform TreeMinerV [13], one of the fastest methods proposed before, in mining large databases. Furthermore, algorithm XSpanner is substantially faster than Chopper in many cases.
An Improved Algorithm Based on FP-growth

郑斌,李涓子

DOI: https://doi.org/10.3969/j.issn.1674-7046.2008.04.004

2008-01-01

Abstract:Association rule mining has become an important and active research topic in the data mining due to its succinct,easy to be explained and understood. It has important theoretical value and the practical significance to study the association rules.After analyzing FP-growth association mining algorithm,this paper proposes an improved algorithm to overcome the low efficiency of FP-growth algorithm by adopting the projection method.The improved algorithm can directly obtain the condition pattern of frequent 1-item,thus it reduces the time cost of building the FP-tree in the FP-growth algorithm.It proved that the improvement algorithm has higher performance than original FP-tree algorithm.
Extract Frequent Pattern from Simple Graph Data.

Qingqing Yuan,Yubo Lou,Haofeng Zhou,Wei Wang,Baile Shi

DOI: https://doi.org/10.1007/3-540-45703-8_15

2002-01-01

Abstract:Mining the frequent pattern from data set is one of the key success stories of data mining research. Currently, most of the efforts are focused on the independent data such as the items in the marketing basket. However, the objects in the real world often have close relationship with each other. How to gain the frequent pattern from these relations is the objective in this paper. We use graphs to model the relations, and select a simple type for analysis. Combining the graph-theory and algorithms to generate frequent patterns, a new structure SFP-Tree and an algorithm, which can mine these simple graphs efficiently, have been proposed. We evaluate the performance of the algorithm by experiments with synthetic datasets. The empirical results show that the SFP can do the job well. At the end of this paper, the potential improvement of SFP is mentioned.
Inverse Frequent Itemset Mining Based on FP-Tree

GUO Yu-Hong,TONG Yun-Hai,TANG Shi-Wei,YANG Dong-Qing

DOI: https://doi.org/10.3724/sp.j.1001.2008.00338

2008-01-01

Journal of Software

Abstract:After the current definition of the inverse frequent set mining problem is expanded and its three practical applications are explored, an FP-tree-based method is proposed for the inverse mining problem.First, the method divides target constraints into some sub constraints and each time it solves a sub linear constraint problem.After some iterations, it finds an FP-tree satisfying the whole given constraints.Then, based on the FP-tree it generates a temporary database TempD that only involves frequent items.The target datasets are obtained by scattering infrequent items into TempD.Theoretic analysis and experiments show that the method is right and efficient.Moreover, compared with the current methods, the method can output more than one target data set.
ESPM - An algorithm to mine frequent subtrees

Yongtai Zhu,Chen Wang,Mingsheng Hong,Wei Wang,Baile Shi

2004-01-01

Abstract:With the development of Internet, frequent pattern mining generalizes to more complex patterns like tree mining and graph mining. Such applications arise in complex domains like Bioinformatics, web mining, etc. In this paper a novel algorithm, named ESPM (expanded subtree pattern miner), is presented to discover frequent subtrees from ordered labeled trees. Unlike previous works, the work of distinguishing isomorphism is left in the later part of the algorithm, which minimizes the cost of the whole process. The performance of the algorithm is evaluated with experiments on synthetic and real datasets. The experimental result shows that the algorithm can do the job well and is better than previous algorithms. Finally the potential improvement of ESPM is mentioned.
Mining Frequent Induced Subtrees by Prefix-Tree-Projected Pattern Growth

Lei Zou,Yansheng Lu,Huaming Zhang,Rong Hu,Chong Zhou

DOI: https://doi.org/10.1109/waimw.2006.20

2006-01-01

Abstract:Frequent subtree pattern mining is an important data mining problem with broad applications. Most existing algorithms, such as Apriori-like algorithms, are based on candidate-generation-and-test framework, except for Chopper and XSpanner [8]. Unfortunately, candidate pattern generation and test used in Apriori-like algorithms are always time and space consuming, and this is especially true when candidate patterns are numerous and large. To solve this problem, the technique of pattern growth was proposed by Han et al [6]. And the famous PrefixSpan algorithm was proposed for sequential pattern mining by Pei et al. in [7]. Along this line, in this paper, we propose a novel induced subtree mining algorithm, called PrefixTreeISpan (i.e. Prefix-Tree-projected Induced-Subtree pattern), which finds induced subtree patterns by growing the frequent prefix-trees. Thus, using divide and conquer, mining local length-1 frequent subtree patterns in Prefix- Tree-Projected database recursively will lead to the complete set of frequent patterns. Different from Chopper and XSpanner, PrefixTreeISpan is for mining induced subtree patterns and it does not need a checking process. Our performance study shows that PrefixTreeISpan has achieved good performance in both different large synthetic datasets and real datasets.
Tree Partition Based Parallel Frequent Pattern Mining on Shared Memory Systems

Dehao Chen,Chunrong Lai,Wei Hu,Wenguang Chen,Yimin Zhang,Weimin Zheng

DOI: https://doi.org/10.1109/ipdps.2006.1639620

2006-01-01

Abstract:In this paper, we present a tree-partition algorithm for parallel mining of frequent patterns. Our work is based on FP-Growth algorithm, which is constituted of tree-building stage and mining stage. The main idea is to build only one FP-Tree in the memory, partition it into several independent parts and distribute them to different threads. A heuristic algorithm is devised to balance the workload. Our algorithm can not only alleviate the impact of locks during the tree-building stage, but also avoid the overhead that do great harm to the mining stage. We present the experiments on different kinds of datasets and compare the results with other parallel approaches. The results suggest that our approach has great advantage in efficiency, especially on certain kinds of datasets. As the number of processors increases, our parallel algorithm shows good scalability.
Fast Algorithm for Discovering Maximum Frequent Pattern

Wang Liang,Jiang Lihong

DOI: https://doi.org/10.3321/j.issn:1002-8331.2006.17.055

2006-01-01

Abstract:This paper presents a fast algorithm DMFP for mining maximum frequent pattern.It introduces maximum depth of FP-Tree and non-frequent 2-itemset,using top-down and bottom-up bidirectional searching strategy to trim candidate itemset in advance.The executing performance of DMFP is better than other similar algorithms.
JPMiner: Mining Frequent Jump Patterns from Graph Databases.

Yong Liu,Jianzhong Li,Hong Gao

DOI: https://doi.org/10.1109/FSKD.2009.670

2009-01-01

Abstract:A major challenge in frequent subgraph mining is the sheer size of its mining results. In many cases, a low minimum support may generate an explosive number of frequent subgraphs, which severely restricts the usage of frequent subgraph mining. In this paper, we study a new problem of mining frequent jump patterns from graph databases. Mining frequent jump patterns can dramatically reduce the number of output graph patterns, and still capture interesting graph patterns. By integrating the operation of checking jump patterns into the well-known DFS code tree enumeration framework, we present an efficient algorithm JPMiner for this new problem. We experimentally evaluate various aspects of JPMiner using both real and synthetic datasets. Experimental results demonstrate that the number of frequent jump patterns is much smaller than that of closed frequent graph patterns, and JPMiner is efficient and scalable in mining frequent jump patterns.
Mop: an Efficient Algorithm for Mining Frequent Pattern with Subtree Traversing

Zhi-Hong Deng,Ning Gao,Xiao-Ran Xu

DOI: https://doi.org/10.3233/fi-2011-568

2011-01-01

Fundamenta Informaticae

Abstract:Mining frequent patterns in database has emerged as an important task in knowledge discovery and data mining. In this paper, we present an efficient algorithm called Mop for fast frequent pattern discovery. Mop utilizes a new kind of data structure called OP_tree (ordered pattern tree) and some particular properties of frequent patterns to facilitate the process of mining frequent patterns. An OP tree is a special frequent pattern tree, where the children of any node are sorted according to the supports of corresponding items. Efficiency of Mop is achieved with three techniques: (1) it adopts OP tree to store a large database to avoid repetitive database scans, (2) it finds all frequent 2-patterns in the construction of OP tree to avoid the costly generation of a large number of candidate 2-patterns, (3) the supports of candidate k-patterns (k>2) can be obtained by traversing a few of specific subtrees of the OP tree, which greatly reduces the search space and avoid multi-scans of a database. We experimentally compare our algorithm with the Apriori algorithm and the FP-growth algorithm on one real database and one synthetical database. The experimental results show that Mop is about an order of magnitude faster than the Apriori algorithm. Mop also outperforms the FP-growth algorithm, especially when support threshold is very low and databases are quite large.
FCIM:new Frequent Closed Itemset Mining Algorithm

LI Shi-song,CHAI Xiao-hui,SONG Shun-lin

DOI: https://doi.org/10.3321/j.issn:1002-8331.2007.33.057

2007-01-01

Computer Engineering and Applications Journal

Abstract:This paper proposes a new approach to mining the frequent closed itemsets in FP-Tree,without duplicates generation and without memory conservation.The experimental performances show that this algorithm outperforms better than other state of the art algorithms.
Mining Frequent Closed Patterns by Adaptive Pruning

刘君强,孙晓莹,庄越挺,潘云鹤

2004-01-01

Journal of Software

Abstract:The set of frequent closed patterns determines exactly the complete set of all frequent patterns and is usually much smaller than the laster. Yet mining frequent closed patterns remains to be a memory and time consuming task. This paper tries to develop an efficient algorithm to solve this problem. The compound frequent item set tree is employed to organize the set of frequent patterns, which consumes much less memory than other structures. The tree is grown quickly by integrating depth first and breadth first search strategies, opportunistically choosing between two different structures to represent projected transaction subsets, and heuristically deciding to build unfiltered pseudo or filtered projections. Efficient pruning methods are used to reduce the search space. The balance of the efficiency and scalability of tree growth and pruning maximizes the performance. The experimental results show that the algorithm is a factor of five to three orders of magnitude more time efficient than several recently proposed algorithms, and is also the most scalable one. It can be used in the discovery of non-redundant association rules, sequence analysis, and many other data mining problems.

Algorithm for mining frequent patterns based on converse FP-tree

Mining Frequent Patterns with the Pattern Tree.

Algorithm for Frequent Pattern Mining Based on FP-Reference-Tree/List

An FP-tree construction algorithm based on exchanging nodes

A Novel Algorithm of Mining Maximal Frequent Pattern Based on Projection Sum Tree

A New Algorithm for Mining Multiple-Level Frequent Patterns

A FP Growth Algorithm Based on MapReduce Model and It′s Application

Dtgc-Tree: A New Strategy Of Association Rules Mining

Mining Frequent Induced Subtree Patterns with Subtree-Constraint

Efficient Pattern-Growth Methods for Frequent Tree Pattern Mining

An Improved Algorithm Based on FP-growth

Extract Frequent Pattern from Simple Graph Data.

Inverse Frequent Itemset Mining Based on FP-Tree

ESPM - An algorithm to mine frequent subtrees

Mining Frequent Induced Subtrees by Prefix-Tree-Projected Pattern Growth

Tree Partition Based Parallel Frequent Pattern Mining on Shared Memory Systems

Fast Algorithm for Discovering Maximum Frequent Pattern

JPMiner: Mining Frequent Jump Patterns from Graph Databases.

Mop: an Efficient Algorithm for Mining Frequent Pattern with Subtree Traversing

FCIM:new Frequent Closed Itemset Mining Algorithm

Mining Frequent Closed Patterns by Adaptive Pruning