Constraint-based sequential pattern mining

PeiJian,HanJiawei,WangWei

2007-01-01

Journal of Intelligent Information Systems

Abstract:Constraints are essential for many sequential pattern mining applications. However, there is no systematic study on constraint-based sequential pattern mining . In this paper, we investigate this i...

What problem does this paper attempt to address?

Constraint-based Sequential Pattern Mining: the Pattern-Growth Methods

Jian Pei,Jiawei Han,Wei Wang

DOI: https://doi.org/10.1007/s10844-006-0006-z

2007-01-01

Journal of Intelligent Information Systems

Abstract:Constraints are essential for many sequential pattern mining applications. However, there is no systematic study on constraint-based sequential pattern mining . In this paper, we investigate this issue and point out that the framework developed for constrained frequent-pattern mining does not fit our mission well. An extended framework is developed based on a sequential pattern growth methodology. Our study shows that constraints can be effectively and efficiently pushed deep into the sequential pattern mining under this new framework. Moreover, this framework can be extended to constraint-based structured pattern mining as well.
Mining Sequential Patterns with Constraints in Large Databases

Jian Pei,Jiawei Han,Wei Wang

DOI: https://doi.org/10.1145/584792.584799

2002-01-01

Abstract:Constraints are essential for many sequential pattern mining applications. However, there is no systematic study on constraint-based sequential pattern mining . In this paper, we investigate this issue and point out that the framework developed for constrained frequent-pattern mining does not fit our missions well. An extended framework is developed based on a sequential pattern growth methodology. Our study shows that constraints can be effectively and efficiently pushed deep into sequential pattern mining under this new framework. Moreover, this framework can be extended to constraint-based structured pattern mining as well.
Prefix-Projection Global Constraint for Sequential Pattern Mining

Amina Kemmar,Samir Loudni,Yahia Lebbah,Patrice Boizumault,Thierry Charnois

DOI: https://doi.org/10.48550/arXiv.1504.07877

2015-06-23

Abstract:Sequential pattern mining under constraints is a challenging data mining task. Many efficient ad hoc methods have been developed for mining sequential patterns, but they are all suffering from a lack of genericity. Recent works have investigated Constraint Programming (CP) methods, but they are not still effective because of their encoding. In this paper, we propose a global constraint based on the projected databases principle which remedies to this drawback. Experiments show that our approach clearly outperforms CP approaches and competes well with ad hoc methods on large datasets.

Artificial Intelligence
Self-adaptive nonoverlapping sequential pattern mining

Yuehua Wang,Youxi Wu,Yan Li,Fang Yao,Philippe Fournier-Viger,Xindong Wu

DOI: https://doi.org/10.1007/s10489-021-02763-y

IF: 5.3

2021-09-14

Applied Intelligence

Abstract:Repetitive sequential pattern mining (SPM) with gap constraints is a data analysis task that consists of identifying patterns (subsequences) appearing many times in a discrete sequence of symbols or events. By using gap constraints, the user can filter many meaningless patterns, and focus on those that are the most interesting for his needs. However, it is difficult to set appropriate gap constraints without prior knowledge. Hence, users generally find suitable constraints by trial and error, which is time-consuming. Besides, current algorithms are inefficient as they repeatedly check whether the gap constraints are satisfied. To address these problems, this paper presents a complete algorithm called SNP-Miner that has two key phases: candidate pattern generation and support (number of occurrences or occurrence frequency) calculation. To reduce the number of candidate patterns, SNP-Miner employs a pattern join strategy. Moreover, to efficiently calculate the support, SNP-Miner uses an incomplete Nettree structure stored in an array, and scans the structure once to avoid redundant calculations and reduce the time complexity. Experimental results show that SNP-Miner not only outperforms competitive algorithms, but can also discover more valuable patterns without user-predefined gap constraints. Algorithms and data can be downloaded from https://github.com/wuc567/Pattern-Mining/tree/master/SNP-Miner.

computer science, artificial intelligence
Constraint-based sequence mining using constraint programming

Benjamin Negrevergne,Tias Guns

DOI: https://doi.org/10.48550/arXiv.1501.01178

2015-02-26

Abstract:The goal of constraint-based sequence mining is to find sequences of symbols that are included in a large number of input sequences and that satisfy some constraints specified by the user. Many constraints have been proposed in the literature, but a general framework is still missing. We investigate the use of constraint programming as general framework for this task. We first identify four categories of constraints that are applicable to sequence mining. We then propose two constraint programming formulations. The first formulation introduces a new global constraint called exists-embedding. This formulation is the most efficient but does not support one type of constraint. To support such constraints, we develop a second formulation that is more general but incurs more overhead. Both formulations can use the projected database technique used in specialised algorithms. Experiments demonstrate the flexibility towards constraint-based settings and compare the approach to existing methods.

Artificial Intelligence
Mining Spatial Co-Location Patterns With Dynamic Neighborhood Constraint

Feng Qian,Qinming He,Jiangfeng He

DOI: https://doi.org/10.1007/978-3-642-04174-7_16

2009-01-01

Abstract:Spatial co-location pattern mining is an interesting and important issue in spatial data mining area which discovers the subsets of features whose events are frequently located together in geographic space. However, previous research literatures for mining co-location patterns assume a static neighborhood constraint that apparently introduces many drawbacks. In this paper, we conclude the preferences that algorithms rely oil when making decisions for mining co-location patterns with dynamic neighborhood constraint. Based on this, we define the mining task as an optimization problem and propose a, greedy algorithm for mining co-location patterns with dynamic neighborhood constraint. The experimental evaluation oil a. real world data set shows that our algorithm has a better capability than the previous approach on finding co-location patterns together with the, consideration of the distribution of data set.
Efficiently Mining Closed Subsequences with Gap Constraints

Chun Li,Jianyong Wang

DOI: https://doi.org/10.1137/1.9781611972788.28

2008-01-01

Abstract:Mining frequent subsequence patterns from sequence databases is a typical data mining problem and various efficient sequential pattern mining algorithms have been proposed. In many problem domains (e.g, biology), the frequent subsequences confined by the predefined gap requirements are more meaningful than the general sequential patterns. In this paper we re-examine the closed sequential pattern mining problem by introducing the gap constraints. The most challenging parts in this task include the constrained pattern closure checking and unpromising search space pruning. Inspired by some state-of-the-art closed or constrained sequential pattern mining algorithms, we propose an efficient approach to finding the complete set of closed sequential patterns with gap constraints. The approach combines the newly devised constrained pattern closure checking scheme and pruning techniques with the pattern growth based subsequence enumeration framework. Our extensive performance study shows that our approach is very efficient in mining frequent closed subsequences with gap constraints.
On Top-K Closed Sequential Patterns Mining

Jing Wang,Lei Zhang,Guiquan Liu,Qi Liu,Enhong Chen

DOI: https://doi.org/10.1109/fskd.2014.6980849

2014-01-01

Abstract:Sequential pattern mining is a very significant data mining project. In this area, most of the previous studies require us to provide a support threshold to accomplish the mining. However, in reality providing an appropriate threshold is very difficult if we did not acquaint with some background information relevant to the data. In addition, there exist many useless sequential patterns when the least support is too low. An alternative task is proposed to solve the above problems: mining top-k frequent closed sequences with the least length constraint, that is, mining k most frequent closed sequences whose length are equal or more than min_len. However, most of the previous algorithms are based on the framework of candidate and generation, thus leading too much space usage and running time. To this end, in this paper, we propose a very efficient algorithm named BI-TSP(Mining top-k closed sequential patterns with BI-Directional checking scheme) without candidate and generation for mining top-k frequent closed sequences with the least length. Specifically, we adopt BI-Directional Extension for frequent closed sequential patterns enumeration. Based on BI-Directional Extension, we can directly use the closure checking scheme and effectively raise the minimum support threshold without candidate maintenance. In addition, we also propose two novel pruning strategies by exploiting the properties of minimum length constraint. Our extensive performance test with synthetic and real datasets demonstrates that BI-TSP outperforms the baselines in both memory and running time.
Mining diverse sets of patterns with constraint programming using the pairwise Jaccard similarity relaxation

Arnold Hien,Noureddine Aribi,Samir Loudni,Yahia Lebbah,Abdelkader Ouali,Albrecht Zimmermann

DOI: https://doi.org/10.1007/s10601-024-09373-8

2024-10-03

Constraints

Abstract:In recent years, pattern mining has evolved from a slow-moving, repetitive three-step process to a much more agile and iterative/user-centric mining model. A crucial element of this framework is the capability to rapidly provide a set of diverse patterns to the user. This paper proposes a pattern mining approach based on constraint programming that incorporates a non-redundancy/diversity constraint into closed pattern enumeration. The level of diversity is controlled through a threshold on the maximum pairwise Jaccard similarity of pattern occurrences. We show that the Jaccard measure does not have nice (anti-)monotonicity properties w.r.t. the general-to-specific enumeration. To address this limitation, we propose anti-monotonic lower and upper-bound relaxations of the Jaccard similarity with nice pruning-enabling properties, and connect the final results to the original Jaccard Index. To evaluate the effectiveness of our relaxations, we conduct a comprehensive comparison against several existing pattern mining techniques designed to control redundancy. Experimental results illustrate that our approach provides an effective solution for mining diverse itemsets, showing competitive performance in both runtime and flexibility.

computer science, artificial intelligence, theory & methods
Mining Sequential Patterns by Pattern-Growth: the PrefixSpan Approach.

J Pei,JW Han,B Mortazavi-Asl,JY Wang,H Pinto,QM Chen,U Dayal,MC Hsu

DOI: https://doi.org/10.1109/tkde.2004.77

IF: 9.235

2004-01-01

IEEE Transactions on Knowledge and Data Engineering

Abstract:Sequential pattern mining is an important data mining problem with broad applications. However, it is also a difficult problem since the mining may have to generate or examine a combinatorially explosive number of intermediate subsequences. Most of the previously developed sequential pattern mining methods, such as GSP, explore a candidate generation-and-test approach [1] to reduce the number of candidates to be examined. However, this approach may not be efficient in mining large sequence databases having numerous patterns and/or long patterns. In this paper, we propose a projection-based, sequential pattern-growth approach for efficient mining of sequential patterns. In this approach, a sequence database is recursively projected into a set of smaller projected databases, and sequential patterns are grown in each projected database by exploring only locally frequent fragments. Based on an initial study of the pattern growth-based sequential pattern mining, FreeSpan [8], we propose a more efficient method, called PSP, which offers ordered growth and reduced projected databases. To further improve the performance, a pseudoprojection technique is developed in PrefixSpan. A comprehensive performance study shows that PrefixSpan, in most cases, outperforms the a priori-based algorithm GSP, FreeSpan, and SPADE [29] ( a sequential pattern mining algorithm that adopts vertical data format), and PrefixSpan integrated with pseudoprojection is the fastest among all the tested algorithms. Furthermore, this mining methodology can be extended to mining sequential patterns with user-specified constraints. The high promise of the pattern-growth approach may lead to its further extension toward efficient mining of other kinds of frequent patterns, such as frequent substructures.
Mining sequential patterns with flexible constraints from MOOC data

Wei Song,Wei Ye,Philippe Fournier-Viger

DOI: https://doi.org/10.1007/s10489-021-03122-7

IF: 5.3

2022-03-23

Applied Intelligence

Abstract:Online learning is playing an increasingly important role in education. Massive open online course (MOOC) platforms are among the most important tools in online learning, and record historical learning data from an extremely large number of learners. To enhance the learning experience, a promising approach is to apply sequential pattern mining (SPM) to discover useful knowledge in these data. In this paper, mining sequential patterns (SPs) with flexible constraints in MOOC enrollment data is proposed, which follows that research approach. Three constraints are proposed: the length constraint, discreteness constraint, and validity constraint. They are used to describe the effect of the length of enrollment sequences, variance of enrollment dates, and enrollment moments, respectively. To improve the mining efficiency, the three constraints are pushed into the support, which is the most typical parameter in SPM, to form a new parameter called support with flexible constraints (SFC). SFC is proved to satisfy the downward closure property, and two algorithms are proposed to discover SPs with flexible constraints. They traverse the search space in a breadth-first and depth-first manner. The experimental results demonstrate that the proposed algorithms effectively reduce the number of patterns, with comparable performance to classical SPM algorithms.

computer science, artificial intelligence
A Multi-Supports-Based Sequential Pattern Mining Algorithm.

Y Xiong,YY Zhu

DOI: https://doi.org/10.1109/cit.2005.22

2005-01-01

Abstract:Sequential pattern mining is now widely used in various areas, such as the analysis of biological sequences, Web access patterns, customer purchase patterns and etc. In this paper, we propose a new definition for M-sequences. Also we present multiple supports: local support, total support, and distribution support for their related mining of local sequential patterns, total sequential patterns and existence sequential patterns. Based on multiple supports, a multi-supports-based sequential pattern mining algorithm is developed which can be generally applied to find such patterns.
Efficient Mining of Gap-Constrained Subsequences and Its Various Applications

Chun Li,Qingyan Yang,Jianyong Wang,Ming Li

DOI: https://doi.org/10.1145/2133360.2133362

IF: 4.157

2012-01-01

ACM Transactions on Knowledge Discovery from Data

Abstract:Mining frequent subsequence patterns is a typical data-mining problem and various efficient sequential pattern mining algorithms have been proposed. In many application domains (e.g., biology), the frequent subsequences confined by the predefined gap requirements are more meaningful than the general sequential patterns. In this article, we propose two algorithms, Gap-BIDE for mining closed gap-constrained subsequences from a set of input sequences, and Gap-Connect for mining repetitive gap-constrained subsequences from a single input sequence. Inspired by some state-of-the-art closed or constrained sequential pattern mining algorithms, the Gap-BIDE algorithm adopts an efficient approach to finding the complete set of closed sequential patterns with gap constraints, while the Gap-Connect algorithm efficiently mines an approximate set of long patterns by connecting short patterns. We also present several methods for feature selection from the set of gap-constrained patterns for the purpose of classification and clustering. Our extensive performance study shows that our approaches are very efficient in mining frequent subsequences with gap constraints, and the gap-constrained pattern based classification/clustering approaches can achieve high-quality results.
An Efficient Algorithm for Mining Frequent Sequence with Constraint Programming

John O. R. Aoga,Tias Guns,Pierre Schaus,John O.R. Aoga

DOI: https://doi.org/10.48550/arXiv.1604.01166

2016-04-05

Databases

Abstract:The main advantage of Constraint Programming (CP) approaches for sequential pattern mining (SPM) is their modularity, which includes the ability to add new constraints (regular expressions, length restrictions, etc). The current best CP approach for SPM uses a global constraint (module) that computes the projected database and enforces the minimum frequency; it does this with a filtering algorithm similar to the PrefixSpan method. However, the resulting system is not as scalable as some of the most advanced mining systems like Zaki's cSPADE. We show how, using techniques from both data mining and CP, one can use a generic constraint solver and yet outperform existing specialized systems. This is mainly due to two improvements in the module that computes the projected frequencies: first, computing the projected database can be sped up by pre-computing the positions at which an symbol can become unsupported by a sequence, thereby avoiding to scan the full sequence each time; and second by taking inspiration from the trailing used in CP solvers to devise a backtracking-aware data structure that allows fast incremental storing and restoring of the projected database. Detailed experiments show how this approach outperforms existing CP as well as specialized systems for SPM, and that the gain in efficiency translates directly into increased efficiency for other settings such as mining with regular expressions.
Benchmarking the effectiveness of sequential pattern mining methods

Hye-Chung Kum,Joong Hyuk Chang,Wei Wang

DOI: https://doi.org/10.1016/j.datak.2006.01.004

IF: 1.5

2007-01-01

Data & Knowledge Engineering

Abstract:Recently, there is an increasing interest in new intelligent mining methods to find more meaningful and compact results. In intelligent data mining research, accessing the quality and usefulness of the results from different mining methods is essential. However, there is no general benchmarking criteria to evaluate whether these new methods are indeed more effective compared to the traditional methods. Here we propose a novel benchmarking criteria that can systematically evaluate the effectiveness of any sequential pattern mining method under a variety of situations. The benchmark evaluates how well a mining method finds known common patterns in synthetic data. Such an evaluation provides a comprehensive understanding of the resulting patterns generated from any mining method empirically. In this paper, the criteria are applied to conduct a detailed comparison study of the support-based sequential pattern model with an approximate pattern model based on sequence alignment. The study suggests that the alignment model will give a good summary of the sequential data in the form of a set of common patterns in the data. In contrast, the support model generates massive amounts of frequent patterns with much redundancy. This suggests that the results of the support model require more post processing before it can be of actual use in real applications.
Mining Frequent Induced Subtree Patterns with Subtree-Constraint

Lei Zou,Yansheng Lu,Huaming Zhang,Rong Hu

DOI: https://doi.org/10.1109/ICDMW.2006.112

2006-01-01

Abstract:Mining frequent induced subtree patterns is very useful in domains such as XML databases, web log analyzing. However, because of the combinatorial explosion, mining all frequent subtree patterns becomes infeasible for a large and dense tree database. And too many frequent subtree patterns also confuse users. Usually only a small set of the mining results can arouse users' interests. In this paper, we propose a problem to discover frequent induced subtree patterns that are super trees of a given pattern tree specified by users, i.e. frequent induced subtree patterns with subtree-constraint. Most existing frequent subtree mining algorithms are based on right-most extension, which does not work well in the new problem. So free extension is presented to replace right-most extension in this paper. To avoid the duplicate pattern problem caused by free extension, we develop an efficient method that ensures no duplicate patterns in mining process or results. Then Subtree- Constraint Frequent Subtree Patterns Mining Algorithm, i.e.SCFS algorithm, is given. The experiment results also show that our algorithm achieves good performance.
Accelerated Frequent Closed Sequential Pattern Mining for Uncertain Data

Tao You,Yue Sun,Ying Zhang,Jinchao Chen,Peng Zhang,Mei Yang

DOI: https://doi.org/10.1016/j.eswa.2022.117254

IF: 8.5

2022-01-01

Expert Systems with Applications

Abstract:Data uncertainty has been taken into a consideration for mining and discovery of its hidden knowledge in a variety of applications. Due to the fact that the nature of closed sequences is closely related to possible world, more recent studies on uncertain closed sequential data mining has usually been challenged by the explosive possible worlds, which is exponential to the number of uncertain sequences in the database. Although basic Probabilistic Frequent Closed Sequences Mining (PFCSM-FF) strategy can solve this problem preliminarily, the inclusion–exclusion rules and closure checking methods used in PFCSM-FF makes mining algorithm very inefficient. And on this basis, another two improvements, PFCSM-CF and PFCSM-CC algorithms, are designed to reduce the search space and simplify the candidate sequence database, which significantly compress the computational scale. Substantial experiments on the real and synthetic datasets have demonstrated the efficiency improvement on the proposed PFCSM-CC and PFCSM-CF methods. Besides, the high usability of the proposed PFCSM-CC algorithm is further demonstrated according to the similarity of the time spent on existing probabilistic frequent sequence mining algorithm.
Imcs: Incremental Mining Of Closed Sequential Patterns

Lei Chang,Dongqing Yang,Tengjiao Wang,Shiwei Tang

DOI: https://doi.org/10.1007/978-3-540-72524-4_9

2007-01-01

Abstract:Recently, mining compact frequent patterns (for example closed patterns and compressed patterns) has received much attention from data mining researchers. These studies try to address the interpretability and efficiency problems encountered by traditional frequent pattern mining methods. However, to the best of our knowledge, how to efficiently mine compact sequential patterns in a dynamic sequence database environment has not been explored yet.In this paper, we examine the problem how to mine closed sequential patterns incrementally. A compact structure CSTree is designed to keep the closed sequential patterns, and an efficient algorithm IMCS is developed to maintain the CSTree when the sequence database is updated incrementally. A thorough experimental study shows that IMCS outperforms the state-of-the-art algorithms - PrefixSpan, CloSpan, BIDE and a recently proposed incremental mining algorithm IncSpan by about a factor of 4 to more than an order of magnitude.
Preference-Based Frequent Pattern Mining

Moonjung Cho,Jian Pei,Haixun Wang,Wei Wang

DOI: https://doi.org/10.4018/jdwm.2005100103

2005-01-01

Abstract:Frequent pattern mining is an important data mining problem with broad applications. Although there are many in-depth studies on efficient frequent pattern mining algorithms and constraint pushing techniques, the effectiveness of frequent pattern mining remains a serious concern: it is non-trivial and often tricky to specify appropriate support thresholds and proper constraints. In this paper, we propose a novel theme of preference-based frequent pattern mining. A user can simply specify a preference instead of setting detailed parameters in constraints. We identify the problem of preference-based frequent pattern mining and formulate the preferences for mining. We develop an efficient framework to mine frequent patterns with preferences. Interestingly, many preferences can be pushed deep into the mining by properly employing the existing efficient frequent pattern mining techniques. We conduct an extensive performance study to examine our method. The results indicate that preference-based frequent pattern mining is effective and efficient. Furthermore, we extend our discussion from pattern-based frequent pattern mining to preference-based data mining in principle and draw a general framework.
Efficient Closed Pattern Mining in the Presence of Tough Block Constraints

Krishna Gade,Jianyong Wang,George Karypis

DOI: https://doi.org/10.1145/1014052.1014070

2004-01-01

Abstract:Various constrained frequent pattern mining problem formulations and associated algorithms have been developed that enable the user to specify various itemset-based constraints that better capture the underlying application requirements and characteristics. In this paper we introduce a new class of block constraints that determine the significance of an itemset pattern by considering the dense block that is formed by the pattern's items and its associated set of transactions. Block constraints provide a natural framework by which a number of important problems can be specified and make it possible to solve numerous problems on binary and real-valued datasets. However, developing computationally efficient algorithms to find these block constraints poses a number of challenges as unlike the different itemset-based constraints studied earlier, these block constraints are tough as they are neither anti-monotone, monotone, nor convertible. To overcome this problem, we introduce a new class of pruning methods that significantly reduce the overall search space and present a computationally efficient and scalable algorithm called CBMiner to find the closed itemsets that satisfy the block constraints.

Constraint-based sequential pattern mining

Constraint-based Sequential Pattern Mining: the Pattern-Growth Methods

Mining Sequential Patterns with Constraints in Large Databases

Prefix-Projection Global Constraint for Sequential Pattern Mining

Self-adaptive nonoverlapping sequential pattern mining

Constraint-based sequence mining using constraint programming

Mining Spatial Co-Location Patterns With Dynamic Neighborhood Constraint

Efficiently Mining Closed Subsequences with Gap Constraints

On Top-K Closed Sequential Patterns Mining

Mining diverse sets of patterns with constraint programming using the pairwise Jaccard similarity relaxation

Mining Sequential Patterns by Pattern-Growth: the PrefixSpan Approach.

Mining sequential patterns with flexible constraints from MOOC data

A Multi-Supports-Based Sequential Pattern Mining Algorithm.

Efficient Mining of Gap-Constrained Subsequences and Its Various Applications

An Efficient Algorithm for Mining Frequent Sequence with Constraint Programming

Benchmarking the effectiveness of sequential pattern mining methods

Mining Frequent Induced Subtree Patterns with Subtree-Constraint

Accelerated Frequent Closed Sequential Pattern Mining for Uncertain Data

Imcs: Incremental Mining Of Closed Sequential Patterns

Preference-Based Frequent Pattern Mining

Efficient Closed Pattern Mining in the Presence of Tough Block Constraints