Fast mining frequent itemsets using Nodesets.

Zhi-Hong Deng,Sheng-Long Lv

DOI: https://doi.org/10.1016/j.eswa.2014.01.025

IF: 8.5

2014-01-01

Expert Systems with Applications

Abstract:•In this paper, we propose a novel data structure for frequent itemset mining.•Based on Nodeset, we present an efficient mining algorithm named FIN.•Experiment results show that FIN outperforms state-of-the-art algorithms.

What problem does this paper attempt to address?

DiffNodesets: An efficient structure for fast mining frequent itemsets.

Zhi-Hong Deng

DOI: https://doi.org/10.1016/j.asoc.2016.01.010

IF: 8.7

2016-01-01

Applied Soft Computing

Abstract:•In this paper, we propose an algorithm named dFIN for frequent itemset mining.•dFIN achieves high performance by employing DiffNodesets to represent itemsets.•Experiment results on real datasets show that dFIN is effective and outperforms state-of-the-art algorithms.
A New Algorithm for Mining Global Frequent Itemsets in a Stream.

Lichao Guo,Hongye Su,Yu Qu

DOI: https://doi.org/10.1109/FSKD.2009.265

2009-01-01

Abstract:To find global frequent itemsets in a multiple, continuous, rapid and time-varying data stream, a fast, incremental, real-time, and little-memory-cost algorithm should be used. Based on the max-frequency window model, a BHS summary structure and a novel algorithm called GGFI-MFW are proposed. It merely updates the summaries for subsets of the data new arrived and could directly generate the max-frequency for a given itemset without scanning the whole summary. Experiment results indicate that the proposed algorithm could efficiently find global frequent itemsets over a data stream with a small memory and perform overwhelming superiority for a large number of distinct items.
Gc-Tree: A Fast Online Algorithm For Mining Frequent Closed Itemsets

Junbo Chen,Shanping Li

DOI: https://doi.org/10.1007/978-3-540-77018-3_45

2007-01-01

Abstract:Frequent closed itemsets is a complete and condensed representaion for all the frequent itemsets, and it's important to generate non-redundant association rules. It has been studied extensively in data mining research, but most of them are clone based on traditional transaction database environment and thus have performance issue under data stream environment. In this paper, a novel approach is proposed to mining closed frequent itemsets over data streams. It is an online algorithm which update frequent closed itemsets incrementally, and can output the Current closed frequent itemsets in real time based on users specified thresholds. The experimental evaluation shows that our proposed method is both time and space efficient, compared with the state of art online frequent closed itemsets algorithm FCI-Stream [3].
Mining Noise-Tolerant Frequent Closed Itemsets in Very Large Database.

Junbo Chen,Bo Zhou,Xinyu Wang,Yiqun Ding,Lu Chen

DOI: https://doi.org/10.1587/transinf.e92.d.1523

2009-01-01

IEICE Transactions on Information and Systems

Abstract:Frequent Itemsets(FI) mining is a popular and important first step in analyzing datasets across a broad range of applications. There are two main problems with the traditional approach for finding frequent itemsets. Firstly, it may often derive an undesirably huge set of frequent itemsets and association rules. Secondly, it is vulnerable to noise. There are two approaches which have been proposed to address these problems individually. The first problem is addressed by the approach Frequent Closed Itemsets(FCI), FCI removes all the redundant information from the result and makes sure there is no information loss. The second problem is addressed by the approach Approximate Frequent Itemsets(AFI), AFI could identify and fix the noises in the datasets. Each of these two concepts has its own limitations, however, the authors find that if FCI and AFI are put together, they could help each other to overcome the limitations and amplify the advantages. The new integrated approach is termed Noise-tolerant Frequent Closed Itemset(NFCI). The results of the experiments demonstrate the advantages of the new approach: (1) It is noise tolerant. (2) The number of itemsets generated would be dramatically reduced with almost no information loss except for the noise and the infrequent patterns. (3) Hence, it is both time and space efficient. (4) No redundant information is in the result.
Approximate mining of global closed frequent itemsets over data streams

Lichao Guo,Hongye Su,Yu Qu

DOI: https://doi.org/10.1016/j.jfranklin.2011.04.006

IF: 4.246

2011-01-01

Journal of the Franklin Institute

Abstract:This paper focuses on how to efficiently find the global Approximate Closed Frequent Itemsets (ACFIs) over streams. To achieve this purpose over a multiple, continuous, rapid and time-varying data stream, a fast, incremental, real-time and little-memory-cost algorithm should be regarded. Based on the max-frequency window model, a Max-Frequency Pattern Tree (MFP-Tree) structure is established to maintain summary information over the global stream. Subsequently, a novel algorithm Generating Global Approximate Closed Frequent Itemsets on Max-Frequency Window model (GGACFI-MFW) is proposed to update the MFP-Tree with high efficiency. The case studies show the efficiency and effectiveness of the proposed approach.
Fast Mining Top-Rank-k Frequent Patterns by Using Node-lists.

Zhi-Hong Deng

DOI: https://doi.org/10.1016/j.eswa.2013.08.075

IF: 8.5

2013-01-01

Expert Systems with Applications

Abstract:Mining Top-Rank-k frequent patterns is an emerging topic in frequent pattern mining in recent years. In this paper, we propose a new mining algorithm, NTK, to mining Top-Rank-k frequent patterns. The NTK algorithm employs a data structure, Node-list, to represent patterns. The Node-list structure makes the mining process much efficient. We have experimentally evaluated our algorithm against two representative algorithms on four real datasets. The experimental results show that the NTK algorithm is efficient and is at least two orders of magnitude faster than the FAE algorithm and also remarkably faster than the VTK algorithm, the recently reported state-of-the-art algorithm for mining Top-Rank-k frequent patterns.
A New Algorithm for Fast Mining Frequent Itemsets Using N-lists

ZhiHong Deng,ZhongHui Wang,JiaJian Jiang

DOI: https://doi.org/10.1007/s11432-012-4638-z

2012-01-01

Science China Information Sciences

Abstract:Mining frequent itemsets has emerged as a fundamental problem in data mining and plays an essential role in many important data mining tasks. In this paper, we propose a novel vertical data representation called N-list, which originates from an FP-tree-like coding prefix tree called PPC-tree that stores crucial information about frequent itemsets. Based on the N-list data structure, we develop an efficient mining algorithm, PrePost, for mining all frequent itemsets. Efficiency of PrePost is achieved by the following three reasons. First, N-list is compact since transactions with common prefixes share the same nodes of the PPC-tree. Second, the counting of itemsets’ supports is transformed into the intersection of N-lists and the complexity of intersecting two N-lists can be reduced to O(m + n) by an efficient strategy, where m and n are the cardinalities of the two N-lists respectively. Third, PrePost can directly find frequent itemsets without generating candidate itemsets in some cases by making use of the single path property of N-list. We have experimentally evaluated PrePost against four state-of-the-art algorithms for mining frequent itemsets on a variety of real and synthetic datasets. The experimental results show that the PrePost algorithm is the fastest in most cases. Even though the algorithm consumes more memory when the datasets are sparse, it is still the fastest one.
An Algorithm of Mining Frequent Itemsets Based on Bloom Filter

林海

2009-01-01

Abstract:Mining maximum frequent itemsets is a key problem in data mining.Aiming at solving the scalable problem for mining frequent itemsets,based on the theory of the Bloom Filter,an algorithm called Mining Top-K is proposed.It can not only mine the K-most frequent elements,but also circumvent the scalable problem of mining frequent itemsets.Especially,with the application of the extended Bloom Filter,the algorithm finding the K-most elements can compute the frequency of the K-most frequent elements.Experiments demonstrate that the algorithm can achieve space saving without sacrificing accuracy.
Mining Maximum Length Frequent Itemsets: A Summary of Results

Tianming Hu,Qian Fu,Xiaonan Wang,Sam Yuan Sung

DOI: https://doi.org/10.1109/ICTAI.2006.84

2006-01-01

Abstract:The use of frequent itemsets has been limited by the high computational cost as well as the large number of resulting itemsets. In many real-world scenarios, however, it is often sufficient to mine a small representative subset of frequent itemsets with low computational cost. To that end, in this paper, we define a new problem of finding the frequent itemsets with a maximum length and present a novel algorithm to solve this problem. Indeed, maximum length frequent itemsets can be efficiently identified in very large data sets and are useful in many application domains. Our algorithm generates the maximum length frequent itemsets by adapting a pattern fragment growth methodology based on the FP-tree structure. Also, a number of optimization techniques have been exploited to prune the search space. Our experimental results show that our algorithm is very efficient and scalable
PrePost+

Zhi-Hong Deng,Sheng-Long Lv

DOI: https://doi.org/10.1016/j.eswa.2015.03.004

2015-01-01

Abstract:In this paper, we propose a algorithm named PrePost+ for frequent itemset mining.PrePost+ employs N-lists to represent itemsets and Children-Parent Equivalence pruning to narrow search space.Experiment results on real datasets show that PrePost+ is effective and outperforms state-of-the-art algorithms. N-list is a novel data structure proposed in recent years. It has been proven to be very efficient for mining frequent itemsets. In this paper, we present PrePost+, a high-performance algorithm for mining frequent itemsets. It employs N-list to represent itemsets and directly discovers frequent itemsets using a set-enumeration search tree. Especially, it employs an efficient pruning strategy named Children-Parent Equivalence pruning to greatly reduce the search space. We have conducted extensive experiments to evaluate PrePost+ against three state-of-the-art algorithms, which are PrePost, FIN, and FP-growth¿, on six various real datasets. The experimental results show that PrePost+ is always the fastest one on all datasets. Moreover, PrePost+ also demonstrates good performance in terms of memory consumption since it use only a litter more memory than FP-growth¿ and less memory than PrePost and FIN.
Fast mining erasable itemsets using NC_sets

Zhi-Hong Deng,Xiao-Ran Xu

DOI: https://doi.org/10.1016/j.eswa.2011.09.143

IF: 8.5

2012-01-01

Expert Systems with Applications

Abstract:Mining erasable itemsets first introduced in 2009 is one of new emerging data mining tasks. In this paper, we present a new data representation called NC_set, which keeps track of the complete information used for mining erasable itemsets. Based on NC_set, we propose a new algorithm called MERIT for mining erasable itemsets efficiently. The efficiency of MERIT is achieved with three techniques as follows. First, the NC_set is a compact structure, which prunes irrelevant data automatically. Second, the computation of the gain of an itemset is transformed into the combination of NC_sets, which can be completed in linear time complexity by an ingenious strategy. Third, MERIT can directly find erasable itemsets without generating candidate itemsets in some cases. For evaluating MERIT, we have conducted extensive experiments on a lot of synthetic product databases. Our performance study shows that the MERIT is efficient and is on average about two orders of magnitude faster than the META, the first algorithm for mining erasable itemsets.
TFP: an Efficient Algorithm for Mining Top-K Frequent Closed Itemsets

JY Wang,JW Han,Y Lu,P Tzvetkov

DOI: https://doi.org/10.1109/tkde.2005.81

IF: 9.235

2005-01-01

IEEE Transactions on Knowledge and Data Engineering

Abstract:Frequent itemset mining has been studied extensively in literature. Most previous studies require the specification of a min/spl I.bar/support threshold and aim at mining a complete set of frequent itemsets satisfying min/spl I.bar/support. However, in practice, it is difficult for users to provide an appropriate min/spl I.bar/support threshold. In addition, a complete set of frequent itemsets is much less compact than a set of frequent closed itemsets. In this paper, we propose an alternative mining task: mining top-k frequent closed itemsets of length no less than min/spl I.bar/l, where k is the desired number of frequent closed itemsets to be mined, and min/spl I.bar/l is the minimal length of each itemset. An efficient algorithm, called TFP, is developed for mining such itemsets without mins/spl I.bar/support. Starting at min/spl I.bar/support = 0 and by making use of the length constraint and the properties of top-k frequent closed itemsets, min/spl I.bar/support can be raised effectively and FP-Tree can be pruned dynamically both during and after the construction of the tree using our two proposed methods: the closed node count and descendant/spl I.bar/sum. Moreover, mining is further speeded up by employing a top-down and bottom-up combined FP-Tree traversing strategy, a set of search space pruning methods, a fast 2-level hash-indexed result tree, and a novel closed itemset verification scheme. Our extensive performance study shows that TFP has high performance and linear scalability in terms of the database size.
An Efficient Data Structure for Fast Mining High Utility Itemsets

Zhi-Hong Deng,Shulei Ma,He Liu

DOI: https://doi.org/10.48550/arXiv.1510.02188

2015-10-08

Abstract:In this paper, we propose a novel data structure called PUN-list, which maintains both the utility information about an itemset and utility upper bound for facilitating the processing of mining high utility itemsets. Based on PUN-lists, we present a method, called MIP (Mining high utility Itemset using PUN-Lists), for fast mining high utility itemsets. The efficiency of MIP is achieved with three techniques. First, itemsets are represented by a highly condensed data structure, PUN-list, which avoids costly, repeatedly utility computation. Second, the utility of an itemset can be efficiently calculated by scanning the PUN-list of the itemset and the PUN-lists of long itemsets can be fast constructed by the PUN-lists of short itemsets. Third, by employing the utility upper bound lying in the PUN-lists as the pruning strategy, MIP directly discovers high utility itemsets from the search space, called set-enumeration tree, without generating numerous candidates. Extensive experiments on various synthetic and real datasets show that PUN-list is very effective since MIP is at least an order of magnitude faster than recently reported algorithms on average.

Databases,Data Structures and Algorithms
An Efficient Structure for Fast Mining High Utility Itemsets

Zhi-Hong Deng

DOI: https://doi.org/10.1007/s10489-017-1130-x

IF: 5.3

2018-01-01

Applied Intelligence

Abstract:High utility itemset mining has emerged to be an important research issue in data mining since it has a wide range of real life applications. Although a number of algorithms have been proposed in recent years, the mining efficiency is still a big challenge since these algorithms suffer from either the problem of low efficiency of calculating candidates' utilities or the problem of generating huge number of candidates. In this paper, we propose a novel data structure named PUN-list (PU-tree-Node list), which maintains both the utility information about an itemset and utility upper bound for facilitating the processing of mining high utility itemsets. Based on PUN-lists, we present a method, named MIP (Mining high utility Itemset using PUN-Lists), for efficiently mining high utility itemsets. The efficiency of MIP is achieved with three techniques. First, itemsets are represented by a highly condensed data structure, named PUN-list, which avoids costly and repeated utility computation. Second, the utility of an itemset can be efficiently calculated by scanning the PUN-list of the itemset and the PUN-lists of long itemsets can be efficiently constructed by the PUN-lists of short itemsets. Third, by employing the utility upper bound lying in the PUN-lists as the pruning strategy, MIP directly discovers high utility itemsets from the search space, named set-enumeration tree, without generating numerous candidates. Extensive experiments on various synthetic and real datasets show that MIP is very efficient since it is much faster than HUI-Miner, d2HUP, and UP-Growth + , especially on dense datasets.
An efficient approach for interactive mining of frequent itemsets

Zhi-Hong Deng,Xin Li,Shi-Wei Tang

DOI: https://doi.org/10.1007/11563952_13

2005-01-01

Abstract:There have been many studies on efficient discovery of frequent itemsets in large databases. However, it is nontrivial to mine frequent itemsets under interactive circumstances where users often change minimum support threshold (minsup) because the change of minsup may invalidate existing frequent itemsets or introduce new frequent itemsets. In this paper, we propose an efficient interactive mining technique based on a novel vertical itemset tree (VI-tree) structure. An important feature of our algorithm is that it does not have to re-examine the existing frequent itemsets when minsup becomes small. Such feature makes it very efficient for interactive mining. The algorithm we proposed has been implemented and its performance is compared with re-running Eclat, a vertical mining algorithm, under different minsup. Experimental results show that our algorithm is over two orders of magnitude faster than the latter in average.
Mining High Occupancy Itemsets.

Zhi-Hong Deng

DOI: https://doi.org/10.1016/j.future.2019.07.039

IF: 7.307

2019-01-01

Future Generation Computer Systems

Abstract:Frequent itemset mining has been extensively studied in data mining for over the last two decades because of its numerous applications. However, the classic support-based mining framework used by most previous studies is not suitable for some real-world applications, such as the travel landscapes recommendation, where occupancy besides support also plays a key role in evaluating the interestingness of an itemset. In this paper, we propose a new kind of tasks based on occupancy, namely high occupancy mining, by introducing occupancy into the support-based mining framework. An efficient algorithm, HEP (abbreviation for High Efficient algorithm for mining high occupancy itemsets), is developed to discover all high occupancy itemsets. HEP use a structure, named occupancy-list, to store the occupancy information about an itemset and employs an iterative level-wise approach to mine high occupancy itemset via a pruning strategy based on upper bound of occupancy. Substantial experiments on both synthetic and real datasets show that HEP is efficient for mining high occupancy itemsets and is at least one order of magnitude faster than the baseline algorithm.
FRI-Miner: Fuzzy Rare Itemset Mining

Yanling Cui,Wensheng Gan,Hong Lin,Weimin Zheng

DOI: https://doi.org/10.48550/arXiv.2103.06866

2021-03-12

Abstract:Data mining is a widely used technology for various real-life applications of data analytics and is important to discover valuable association rules in transaction databases. Interesting itemset mining plays an important role in many real-life applications, such as market, e-commerce, finance, and medical treatment. To date, various data mining algorithms based on frequent patterns have been widely studied, but there are a few algorithms that focus on mining infrequent or rare patterns. In some cases, infrequent or rare itemsets and rare association rules also play an important role in real-life applications. In this paper, we introduce a novel fuzzy-based rare itemset mining algorithm called FRI-Miner, which discovers valuable and interesting fuzzy rare itemsets in a quantitative database by applying fuzzy theory with linguistic meaning. Additionally, FRI-Miner utilizes the fuzzy-list structure to store important information and applies several pruning strategies to reduce the search space. The experimental results show that the proposed FRI-Miner algorithm can discover fewer and more interesting itemsets by considering the quantitative value in reality. Moreover, it significantly outperforms state-of-the-art algorithms in terms of effectiveness (w.r.t. different types of derived patterns) and efficiency (w.r.t. running time and memory usage).

Databases
Efficient Algorithm for Mining of Frequent Itemsets over Uncertain Data Streams

Liu Yinlei,Liu Yubao,Chen Cheng

2011-01-01

Journal of Computer Research and Development

Abstract:Uncertain data streams exist in lots of real applications,such as,sensor network data and tracks of mobile object etc.In existing frequent itemsets mining algorithms over uncertain data streams,the generalized data structure used to store uncertain data streams is often complex and difficult to maintain,and the mining algorithm cost is also expensive.In this paper,we present a new generalized data structure,that is,SRUF-tree,to store uncertain data streams.In detail,this data structure includes three key components,namely,global SRtree,temporary table,and windows queue.All itemsets in recent window are contained in global SRtree in a condensed format.Each batch of itemset information is stored in temporary table.Based on SRUF-tree,we also present a new mining algorithm for frequent itemsets,that is,SRUF-mine algorithm.This algorithm searches in depth the global tree to find frequent itemsets.The maintaining of SRUF-tree is simple and just handles the temporary table corresponds to the oldest batch of itemsets in windows queue.The compared experiment results with existing UF-streaming algorithm show the efficiency of our presented algorithm SRUF-mine.
Mining Approximate Frequent Itemsets from Noisy Data

JZ Liu,S Paulsen,W Wang,A Nobel,J Prins

DOI: https://doi.org/10.1109/icdm.2005.93

2005-01-01

Abstract:Frequent itemset mining is a popular and important first step in analyzing data sets across a broad range of applications. The traditional, "exact" approach for finding frequent itemsets requires that every item in the itemset occurs in each supporting transaction. However, real data is typically subject to noise, and in the presence of such noise, traditional itemset mining may fail to detect relevant itemsets, particularly those large itemsets that are more vulnerable to noise. In this paper we propose approximate frequent itemsets (AFI), as a noise-tolerant itemset model. In addition to the usual requirement for sufficiently many supporting transactions, the AFI model places constraints on the fraction of errors permitted in each item column and the fraction of errors permitted in a supporting transaction. Taken together, these constraints winnow out the approximate itemsets that exhibit systematic errors. In the context of a simple noise model, we demonstrate that AFI is better at recovering underlying data patterns, while identifying fewer spurious patterns than either the exact frequent itemset approach or the existing error tolerant itemset approach of Yang et al.
A Distributed Method for Fast Mining Frequent Patterns From Big Data

Peng-Yu Huang,Wan-Shu Cheng,Ju-Chin Chen,Wen-Yu Chung,Young-Lin Chen,Kawuu W. Lin

DOI: https://doi.org/10.1109/access.2021.3115514

IF: 3.9

2021-01-01

IEEE Access

Abstract:In recent years, knowledge discovery in databases provides a powerful capability to discover meaningful and useful information. For numerous real-life applications, frequent pattern mining and association rule mining have been extensively studied. In traditional mining algorithms, data are centralized and memory-resident. As a result of the large amount of data, bandwidth limitation, and energy limitations when applying these methods to distributed databases, especially in this era of big data, the performance is not effective enough. Hence, data mining on distributed environments has emerged as an important research area. To improve the performance, we propose a set of algorithms based on FP growth that discover FPs that are capable of providing fast and scalable service in distributed computing environments and a brief data structure to store items and counts to minimize the data for transmission on the network. To ensure completeness and execution capability, DistEclat and BigFIM were considered for the experiment comparison. Experiments show that the proposed method has superior cost-effectiveness for processing massive datasets and good capabilities under various experiment conditions. The proposed method on average required only 33% of the execution time and 45% of the transmission cost of DistEclat. Compared to BigFIM, The proposed method on average required 23.3% of the execution time and 14.2% of the transmission cost of BigFIM.

computer science, information systems,telecommunications,engineering, electrical & electronic

Fast mining frequent itemsets using Nodesets.

DiffNodesets: An efficient structure for fast mining frequent itemsets.

A New Algorithm for Mining Global Frequent Itemsets in a Stream.

Gc-Tree: A Fast Online Algorithm For Mining Frequent Closed Itemsets

Mining Noise-Tolerant Frequent Closed Itemsets in Very Large Database.

Approximate mining of global closed frequent itemsets over data streams

Fast Mining Top-Rank-k Frequent Patterns by Using Node-lists.

A New Algorithm for Fast Mining Frequent Itemsets Using N-lists

An Algorithm of Mining Frequent Itemsets Based on Bloom Filter

Mining Maximum Length Frequent Itemsets: A Summary of Results

PrePost+

Fast mining erasable itemsets using NC_sets

TFP: an Efficient Algorithm for Mining Top-K Frequent Closed Itemsets

An Efficient Data Structure for Fast Mining High Utility Itemsets

An Efficient Structure for Fast Mining High Utility Itemsets

An efficient approach for interactive mining of frequent itemsets

Mining High Occupancy Itemsets.

FRI-Miner: Fuzzy Rare Itemset Mining

Efficient Algorithm for Mining of Frequent Itemsets over Uncertain Data Streams

Mining Approximate Frequent Itemsets from Noisy Data

A Distributed Method for Fast Mining Frequent Patterns From Big Data