Abstract:Given a data matrix D , a submatrix S of D is an order-preserving submatrix (OPSM) if there is a permutation of the columns of S , under which the entry values of each row in S are strictly increasing. OPSM mining is widely used in real-life applications such as identifying coexpressed genes, and finding customers with similar preference. However, noise is ubiquitous in real data matrices due to variable experimental conditions and measurement errors, which makes conventional OPSM mining algorithms inapplicable. No previous work has ever combated uncertain value intervals using the well-established possible world semantics . We establish two different definitions of significant OPSMs based on the possible world semantics : (1) expected support based and (2) probabilistic frequentness based. An optimized dynamic programming approach is proposed to compute the probability that a row supports a particular column permutation, with a closed-form formula derived to efficiently handle the special case of uniform value distribution, and an accurate cubic spline approximation approach that works well with any uncertain value distributions. To efficiently check the probabilistic frequentness, several effective pruning rules are designed to efficiently prune insignificant OPSMs; two approximation techniques based on the Poisson and Gaussian distributions, respectively, are proposed for further speedup. These techniques are integrated into our two OPSM mining algorithms, based on prefix-projection and Apriori, respectively. We further parallelize our prefix-projection based mining algorithm using PrefixFPM, a recently proposed framework for parallel frequent pattern mining, and we achieve a good speedup with the number of CPU cores. Extensive experiments on real microarray data demonstrate that the OPSMs found by our algorithms have a much higher quality than those found by existing approaches.

Accelerated Frequent Closed Sequential Pattern Mining for Uncertain Data

Mining Top-k Minimal Redundancy Frequent Patterns over Uncertain Databases.

Mining Probabilistically Frequent Sequential Patterns in Large Uncertain Databases

Frequent Pattern Mining with Uncertain Data

Frequent Pattern Mining Algorithms With Uncertain Data

Mining Noise-Tolerant Frequent Closed Itemsets in Very Large Database.

Mining Associated and Item-Item Correlated Frequent Patterns

Sequential Pattern Mining in Databases with Temporal Uncertainty

Mining Sequential Patterns in Uncertain Databases Using Hierarchical Index Structure

Towards utility-driven contiguous sequential patterns in uncertain multi-sequences

Mining Algorithm of Frequent Closed Itemsets Based on Uncertain Data

Towards Efficient Sequential Pattern Mining in Temporal Uncertain Databases

Efficient Probabilistic Frequent Itemset Mining In Big Sparse Uncertain Data

Frequent Closed Sequence Mining Without Candidate Maintenance

Mining Order-Preserving Submatrices Under Data Uncertainty: A Possible-World Approach and Efficient Approximation Methods

A Two-Phase Approach for Unexpected Pattern Mining.

Mining frequent itemset from uncertain data

Mining Weighted Sequential Patterns in Incremental Uncertain Databases

Imcs: Incremental Mining Of Closed Sequential Patterns

Mining Uncertain Sequential Patterns in Iterative MapReduce

Efficient algorithms for incremental maintenance of closed sequential patterns in large databases