Efficient mining of frequent closed XML query pattern

FengJian-Hua,QianQian,WangJian-Yong,ZhouLi-Zhu

IF: 1.871

2007-01-01

Journal of Computer Science and Technology

Abstract:Previous research works have presented convincing arguments that a frequent pattern mining algorithm should not mine all frequent but only the closed ones because the latter leads to not only more ...

What problem does this paper attempt to address?

Efficient Mining of Frequent Closed XML Query Pattern.

Jian-Hua Feng,Qian,Jian-Yong Wang,Li-Zhu Zhou

DOI: https://doi.org/10.1007/s11390-007-9081-z

2007-01-01

Abstract:Previous research works have presented convincing arguments that a frequent pattern mining algorithm should not mine all frequent but only the closed ones because the latter leads to not only more compact yet complete result set but also better efficiency. Upon discovery of frequent closed XML query patterns, indexing and caching can be effectively adopted for query performance enhancement. Most of the previous algorithms for finding frequent patterns basically introduced a straightforward generate-and-test strategy. In this paper, we present SOLARIA*, an efficient algorithm for mining frequent closed XML query patterns without candidate maintenance and costly tree-containment checking. Efficient algorithm of sequence mining is involved in discovering frequent tree-structured patterns, which aims at replacing expensive containment testing with cheap parent-child checking in sequences. SOLARIA* deeply prunes unrelated search space for frequent pattern enumeration by parent-child relationship constraint. By a thorough experimental study on various real-life data, we demonstrate the efficiency and scalability of SOLARIA* over the previous known alternative. SOLARIA* is also linearly scalable in terms of XML queries' size.
Exploit Sequencing to Accelerate Hot XML Query Pattern Mining

Jianhua Feng,Qian,Jianyong Wang,Lizhu Zhou

DOI: https://doi.org/10.1145/1141277.1141400

2006-01-01

Abstract:Speeding up query evaluation in large XML repositories becomes a challenging and all-important problem with vast XML-related applications arising. Upon discovery of hot XML query patterns, indexing and caching can be effectively adopted for query performance enhancement. Previous algorithms for finding hot query patterns basically introduced a straightforward generate-and-test strategy. In this paper, we present, SOLARIA, an efficient algorithm for mining hot XML query patterns without candidate maintenance and costly tree-containment checking. Efficient algorithm of sequence mining is involved in discovering frequent tree-structured patterns, which aims at replacing expensive containment testing with cheap parent-child checking in sequences. SOLARIA deeply prunes unrelated search space for frequent pattern enumeration by parent-child relationship constraint. With the motivation of indexing and caching in XML query optimization, we also propose the derived algorithm SOLARIA for mining hot "closed" XML query patterns which provide compact and complete structure information. By a thorough experimental study on various real-life data, we demonstrate the efficiency and scalability of SOLARIA over the previous known alternative. SOLARIA is also linearly scalable in terms of XML queries' size.
Research of frequent pattern mining from XML data based on heterogeneous XML schema

Houqun Yang,Zhongshi He,Wenting Liang

2008-01-01

Journal of Computational Information Systems

Abstract:This paper researches frequent pattern mining algorithm based on heterogeneous XML schema. Proposed schemas similarity clustering in advance, and then the corresponding XML data are modeled as labeled ordered trees. This algorithm used rightmost path expansion method, which starts with pattern trees with only one node and the nodes are added only to the rightmost path gradually to generate new pattern trees. The number of candidate patterns is small because of utilizing the information of the frequent patterns discovered in the pervious iteration. To improve mining efficiency, this paper utilizes projected branch technique solving the problem with distinguishing isomorphism at the same time. Finally, a group of XML data is applied to test the performance of the algorithm and the experimental result is compared with other algorithms. Experimental results showed that the algorithm is efficient and feasible.
Mining frequent association tag sequences for clustering XML documents

Lijun Zhang,Zhanhuai Li,Qun Chen,Xia Li,Ning Li,Ying Lou

DOI: https://doi.org/10.1007/978-3-642-29253-8_8

2012-01-01

Abstract:Many XML document clustering algorithms need to compute similarity among documents. Due to its semi-structured characteristic, exploiting the structure information for computing structural similarity is a crucial issue in XML similarity computation. Some path based approaches model the structure as path set and use the path set to compute structural similarity. One of the defects of these approaches is that they ignore the relationship between paths. In this paper, we propose the conception of Frequent Association Tag Sequences (FATS). Based on this conception, we devise an algorithm named FATSMiner for mining FATS and model the structure of XML documents as FATS set, and introduce a method for computing structural similarity using FATS. Because FATS implies the ancestor-descendant and sibling relationships among elements, this approach can better represent the structure of XML documents. Our experimental results on real datasets show that this approach is more effective than the other path based approaches.
Discovery of Frequent Query Patterns in XML Pattern Graph with DTD Cardinality Constraints

Yunfeng Liu,Dongqing Yang,Shiwei Tang,Tengjiao Wang,Jun Gao

DOI: https://doi.org/10.1109/cisis.2008.95

2004-01-01

Abstract:Common query patterns of multiple XML queries can be stored and shared to accelerate the query execution efficiently. We present a new technique for efficiently mining frequent XML query patterns with DTD cardinality constraints. We first introduce a new definition of extended subtree for XML query patterns (EST), which provides a model for supporting special characters of "common" XML query pattern. Then we "push" the DTD cardinality constraints deep into the mining process to prune the search space and still ensure the completeness of the answers. Finally, we propose an algorithm FEST for effectively mining frequent ESTs to improve the query performance for XML data management system.
Mining Frequent Closed Patterns by Adaptive Pruning

刘君强,孙晓莹,庄越挺,潘云鹤

2004-01-01

Journal of Software

Abstract:The set of frequent closed patterns determines exactly the complete set of all frequent patterns and is usually much smaller than the laster. Yet mining frequent closed patterns remains to be a memory and time consuming task. This paper tries to develop an efficient algorithm to solve this problem. The compound frequent item set tree is employed to organize the set of frequent patterns, which consumes much less memory than other structures. The tree is grown quickly by integrating depth first and breadth first search strategies, opportunistically choosing between two different structures to represent projected transaction subsets, and heuristically deciding to build unfiltered pseudo or filtered projections. Efficient pruning methods are used to reduce the search space. The balance of the efficiency and scalability of tree growth and pruning maximizes the performance. The experimental results show that the algorithm is a factor of five to three orders of magnitude more time efficient than several recently proposed algorithms, and is also the most scalable one. It can be used in the discovery of non-redundant association rules, sequence analysis, and many other data mining problems.
Frequent Closed Sequence Mining Without Candidate Maintenance

Jianyong Wang,Jiawei Han,Chun Li

DOI: https://doi.org/10.1109/tkde.2007.1043

IF: 9.235

2007-01-01

IEEE Transactions on Knowledge and Data Engineering

Abstract:Previous studies have presented convincing arguments that a frequent pattern mining algorithm should not mine all frequent patterns but only the closed ones because the latter leads to not only a more compact yet complete result set but also better efficiency. However, most of the previously developed closed pattern mining algorithms work under the candidate maintenance-and-test paradigm, which is inherently costly in both runtime and space usage when the support threshold is low or the patterns become long. In this paper, we present BIDE, an efficient algorithm for mining frequent closed sequences without candidate maintenance. It adopts a novel sequence closure checking scheme called BI-Directional Extension and prunes the search space more deeply compared to the previous algorithms by using the BackScan pruning method. A thorough performance study with both sparse and dense, real, and synthetic data sets has demonstrated that BIDE significantly outperforms the previous algorithm: It consumes an order(s) of magnitude less memory and can be more than an order of magnitude faster. It is also linearly scalable in terms of database size.
Incremental Mining of Frequent Query Patterns from XML Queries for Caching

Guoliang Li,Jianhua Feng,Jianyong Wang,Yong Zhang

DOI: https://doi.org/10.1109/ICDM.2006.88

2006-01-01

Abstract:Existing studies for mining frequent XML query patterns mainly introduce a straightforward candidate generate-and-test strategy and compute frequencies of candidate query patterns from scratch periodically by checking the entire transaction database, which consists of XML query patterns transformed from user queries. However, it is nontrivial to maintain such discovered frequent patterns in real XML databases because there may incur frequent updates that may not only invalidate some existing frequent query patterns but also generate some new frequent ones. Accordingly, existing proposals are inefficient for the evolution of the transaction database. To address these problems, this paper presents an efficient algorithm IPS-FXQPMiner for mining frequent XML query patterns without candidate maintenance and costly tree-containment checking. We transform XML queries into sequences through a one- to-one mapping and then mine the frequent sequences to generate frequent XML query patterns. More importantly, based on IPS-FXQPMiner, an efficient incremental algorithm, Incre-FXQPMiner is proposed to incrementally mine frequent XML query patterns, which can minimize the I/O and computation requirements for handling incremental updates. Our experimental study on various real-life datasets demonstrates the efficiency and scalability of our algorithms over previous known alternatives.
Bottom-up Discovery of Frequent Rooted Unordered Subtrees

Yijun Bei,Gang Chen,Lidan shou,Xiaoyan Li,Jinxiang Dong

DOI: https://doi.org/10.1016/j.ins.2008.08.020

IF: 8.1

2008-01-01

Information Sciences

Abstract:In the past decade, XML has emerged as the standard language for information exchanging over the Internet. Due to its tree-structure paradigm, XML is superior for its capability of storing, querying, and manipulating complex data. Therefore, discovering frequent tree patterns over tree-structured data has become an interesting topic for XML data management. In this paper, we propose a tree mining algorithm, named BUXMiner, for finding a special class of frequent trees, called rooted unordered trees, from a tree-structured database. BUXMiner employs an efficient bottom-up approach to enumerate all candidate trees over a compact global tree guide and computes the frequent trees based on the tree guide. In addition to BUXMiner, we also propose a mining approach called BUMXMiner to discover the maximal frequent rooted unordered trees. We compare BUXMiner with previous tree-structure mining algorithms, namely XQPMinerTID and FastXMiner, which were also proposed to discover rooted unordered trees. The experimental results show that our algorithm outperforms XQPMinerTID and FastXMiner in terms of efficiency. The performance results from real-world applications also indicate the usefulness of our proposed tree mining algorithms in a variety of web applications, such as analysis of web page access patterns and mining frequent XML query patterns for caching.
Buxminer: An Efficient Bottom-Up Approach To Mining Xml Query Patterns

Yijun Bei,Gang Chen,Jinxiang Dong

DOI: https://doi.org/10.1007/978-3-540-72524-4_73

2007-01-01

Abstract:Discovery of frequent XML query patterns in the history log of XML queries can be used to expedite XML query processing, as the answers to these queries can be cached and reused when the future queries "hit" such frequent patterns. In this paper, we propose an efficient bottom-up mining approach to finding frequent query patterns in XML queries. We merge all queries into a summarizing structure named global tree guide (GTG). We refine GTG by pruning infrequent nodes and clustering adjacent nodes in the queries to obtain a Compressed GTG (known as CGTG). We employ a bottom-up traversal scheme based on CGTG to generate frequent query patterns for each node till the root of CGTG. Experiments show that our proposed method is efficient and outperforms the previous mining algorithms of XML queries, such as XQPMinerTID and FastXMiner.
BIDE: Efficient Mining of Frequent Closed Sequences

JY Wang,JW Han

DOI: https://doi.org/10.1109/icde.2004.1319986

2004-01-01

Abstract:Previous studies have presented convincing arguments that a frequent pattern mining algorithm should not mine all frequent patterns but only the closed ones because the latter leads to not only more compact yet complete result set but also better efficiency. However, most of the previously developed closed pattern mining algorithms work under the candidate maintenance-and-test paradigm which is inherently costly in both runtime and space usage when the support threshold is low or the patterns become long. We present, BIDE, an efficient algorithm for mining frequent closed sequences without candidate maintenance. We adopt a novel sequence closure checking scheme called bidirectional extension, and prunes the search space more deeply compared to the previous algorithms by using the BackScan pruning method and the Scan-Skip optimization technique. A thorough performance study with both sparse and dense real-life data sets has demonstrated that BIDE significantly outperforms the previous algorithms: it consumes order(s) of magnitude less memory and can be more than an order of magnitude faster. It is also linearly scalable in terms of database size.
Improving Xml Querying with Maximal Frequent Query Patterns

Yijun Bei,Gang Chen,Jinxiang Dong

DOI: https://doi.org/10.1007/978-3-540-72584-8_34

2007-01-01

Abstract:Querying on XML data is a computational-expensive process due to the complex nature of both the XML data and the query. In this paper, we propose an approach to expedite XML query processing by caching the results of a specific class of queries, namely the maximal frequent queries. We mine the maximal frequent query patterns from user-issued queries and cache the results of such queries. We propose a recursive algorithm for query processing using the cached query results. Query rewriting is employed to deal with four kinds of similar queries namely exact matching, exact containment, semantic matching and semantic containment. We perform experiments on the XMARK datasets and show that the proposed methods are both effective and efficient in improving the performance of XML queries.
Caching Frequent XML Query Patterns

Xin Zhan,Jianzhong Li,Hongzhi Wang,Zhenying He

DOI: https://doi.org/10.1007/11610496_8

2006-01-01

Abstract:As XML becomes prevailing on the Internet, efficient management of XML queries becomes more important. Caching frequent queries can expedite XML query processing. In this paper, we propose a framework to address an NP-hard optimization problem, caching frequent query patterns. We develop several algorithms to respectively generate query subpatterns, check query containment, and choose query subpatterns for caching. Experimental results show that our algorithms are efficient and scalable.
Study of Improved Algorithm for Mining Based on Frequent Pattern Array

LI Wei,LI Xian-guo

DOI: https://doi.org/10.3969/j.issn.1671-1815.2010.04.040

2010-01-01

Abstract:A matrix based on frequent pattern mining frequent pattern array of the improved algorithm is presented. First,each item' s projection matrix pre-divided into a number of the same-dimensional matrix,and in accordance with the dimensional weight matrix search of the remaining items are not pre-judge,and then search for effective maximum frequent item sets pruning,reducing the search.Through experiments and analysis of algorithms, proof of this improved algorithm has obvious advantages.
Efficient Mining Frequent Closed Resource Patterns in Resource Effectiveness Data: The MFPattern Approach

lihua zhang,miao wang,qingfan gu,zhengjun zhai,guoqing wang

DOI: https://doi.org/10.1007/978-3-642-54233-6_4

2014-01-01

Abstract:As the occurrence of failure of electronic resources is sudden, real-time record analysis on the effectiveness of all resources in the system can discover abnormal resources earlier and start using backup resources or restructure resources in time, thus managing abnormal situations and finally realizing health management of the system. This paper proposed an algorithm for mining frequent closed resource patterns from data effectiveness matrix with the method of column extension: MFPattern, which uses effective pruning strategies to guarantee the mining of all frequent closed patterns without producing candidate item-sets. Different from the traditional frequent closed pattern, MFPattern algorithm can mine resource combination patterns with all resources very effective during work, those with simultaneous failure of resources and combination patterns in which some resources are very effective while some other resources have failure. The experimental result shows that this algorithm has a higher mining efficiency than existing mining methods of frequent closed pattern.
CFGM: an Algorithm for Closed Frequent Graph Patterns Mining

He Peng,Defu Zhang

DOI: https://doi.org/10.1016/j.ins.2022.12.089

IF: 8.1

2023-01-01

Information Sciences

Abstract:The extraction of frequent subgraphs is a basic and well studied operation on graphs. Thus, mining frequent graph patterns and problems associated with it is very important. However, the number of frequent subgraphs is potentially exponential while mining large graph patterns. This issue can be partly overcome using closed frequent graphs mining. Instead of mining all frequent subgraphs, it is more efficient to enumerate only the closed frequent graphs. Thus, in this paper, we propose a novel closed frequent subgraph mining algorithm: CFGM. In this algorithm, a stack-based architecture is used to enumerate the frequent graph represented by the depth-first search. Moreover, this algorithm defines a strict partial order among frequent graphs. We demonstrate that, with respect to this strict partial order, only maximal elements (frequent graphs) need to be discovered. A pruning strategy is developed based on this strict partial order that dramatically reduces unnecessary frequent subgraphs to be enumerated. Computational results show our algorithm displays excellent performance, especially for some large asymmetric frequent graph patterns.
Bottom-Up Mining of Xml Query Patterns to Improve Xml Querying

Yi-jun Bei,Gang Chen,Jin-xiang Dong,Ke Chen

DOI: https://doi.org/10.1631/jzus.a071551

2008-01-01

Abstract:Querying XML data is a computationally expensive process due to the complex nature of both the XML data and the XML queries. In this paper we propose an approach to expedite XML query processing by caching the results of frequent queries. We discover frequent query patterns from user-issued queries using an efficient bottom-up mining approach called VBUXMiner. VBUXMiner consists of two main steps. First, all queries are merged into a summary structure named "compressed global tree guide" (CGTG). Second, a bottom-up traversal scheme based on the CGTG is employed to generate frequent query patterns. We use the frequent query patterns in a cache mechanism to improve the XML query performance. Experimental results show that our proposed mining approach outperforms the previous mining algorithms for XML queries, such as XQPMiner TID and FastXMiner, and that by caching the results of frequent query patterns, XML query performance can be dramatically improved.
Accelerated Frequent Closed Sequential Pattern Mining for Uncertain Data

Tao You,Yue Sun,Ying Zhang,Jinchao Chen,Peng Zhang,Mei Yang

DOI: https://doi.org/10.1016/j.eswa.2022.117254

IF: 8.5

2022-01-01

Expert Systems with Applications

Abstract:Data uncertainty has been taken into a consideration for mining and discovery of its hidden knowledge in a variety of applications. Due to the fact that the nature of closed sequences is closely related to possible world, more recent studies on uncertain closed sequential data mining has usually been challenged by the explosive possible worlds, which is exponential to the number of uncertain sequences in the database. Although basic Probabilistic Frequent Closed Sequences Mining (PFCSM-FF) strategy can solve this problem preliminarily, the inclusion–exclusion rules and closure checking methods used in PFCSM-FF makes mining algorithm very inefficient. And on this basis, another two improvements, PFCSM-CF and PFCSM-CC algorithms, are designed to reduce the search space and simplify the candidate sequence database, which significantly compress the computational scale. Substantial experiments on the real and synthetic datasets have demonstrated the efficiency improvement on the proposed PFCSM-CC and PFCSM-CF methods. Besides, the high usability of the proposed PFCSM-CC algorithm is further demonstrated according to the similarity of the time spent on existing probabilistic frequent sequence mining algorithm.
Efficient Pattern-Growth Methods for Frequent Tree Pattern Mining

Chen Wang,Mingsheng Hong,Jian Pei,Haofeng Zhou,Wei Wang,Baile Shi

DOI: https://doi.org/10.1007/978-3-540-24775-3_54

2004-01-01

Abstract:Mining frequent tree patterns is an important research problems with broad applications in bioinformatics, digital library, e-commerce, and so on. Previous studies highly suggested that pattern-growth methods are efficient in frequent pattern mining. In this paper, we systematically develop the pattern growth methods for mining frequent tree patterns. Two algorithms, Chopper and XSpanner, are devised. An extensive performance study shows that the two newly developed algorithms outperform TreeMinerV [13], one of the fastest methods proposed before, in mining large databases. Furthermore, algorithm XSpanner is substantially faster than Chopper in many cases.
Top-Down Mining of Frequent Closed Patterns from Very High Dimensional Data

Hongyan Liu,Jiawei Han,Dong Xin,Zheng Shao

DOI: https://doi.org/10.1016/j.ins.2008.11.033

IF: 8.1

2009-01-01

Information Sciences

Abstract:Frequent pattern mining is an essential theme in data mining. Existing algorithms usually use a bottom-up search strategy. However, for very high dimensional data, this strategy cannot fully utilize the minimum support constraint to prune the rowset search space. In this paper, we propose a new method called top-down mining together with a novel row enumeration tree to make full use of the pruning power of the minimum support constraint. Furthermore, to efficiently check if a rowset is closed, we develop a method called the trace-based method. Based on these methods, an algorithm called TD-Close is designed for mining a complete set of frequent closed patterns. To enhance its performance further, we improve it by using new pruning strategies and new data structures that lead to a new algorithm TTD-Close. Our performance study shows that the top-down strategy is effective in cutting down search space and saving memory space, while the trace-based method facilitates the closeness-checking. As a result, the algorithm TTD-Close outperforms the bottom-up search algorithms such as Carpenter and FPclose in most cases. It also runs faster than TD-Close.

Efficient mining of frequent closed XML query pattern

Efficient Mining of Frequent Closed XML Query Pattern.

Exploit Sequencing to Accelerate Hot XML Query Pattern Mining

Research of frequent pattern mining from XML data based on heterogeneous XML schema

Mining frequent association tag sequences for clustering XML documents

Discovery of Frequent Query Patterns in XML Pattern Graph with DTD Cardinality Constraints

Mining Frequent Closed Patterns by Adaptive Pruning

Frequent Closed Sequence Mining Without Candidate Maintenance

Incremental Mining of Frequent Query Patterns from XML Queries for Caching

Bottom-up Discovery of Frequent Rooted Unordered Subtrees

Buxminer: An Efficient Bottom-Up Approach To Mining Xml Query Patterns

BIDE: Efficient Mining of Frequent Closed Sequences

Improving Xml Querying with Maximal Frequent Query Patterns

Caching Frequent XML Query Patterns

Study of Improved Algorithm for Mining Based on Frequent Pattern Array

Efficient Mining Frequent Closed Resource Patterns in Resource Effectiveness Data: The MFPattern Approach

CFGM: an Algorithm for Closed Frequent Graph Patterns Mining

Bottom-Up Mining of Xml Query Patterns to Improve Xml Querying

Accelerated Frequent Closed Sequential Pattern Mining for Uncertain Data

Efficient Pattern-Growth Methods for Frequent Tree Pattern Mining

Top-Down Mining of Frequent Closed Patterns from Very High Dimensional Data