Abstract:Significant pattern mining is a fundamental task in mining transactional data, requiring to identify patterns significantly associated with the value of a given feature, the target. In several applications, such as biomedicine, basket market analysis, and social networks, the goal is to discover patterns whose association with the target is defined with respect to an underlying population, or process, of which the dataset represents only a collection of observations, or samples. A natural way to capture the association of a pattern with the target is to consider its statistical significance, assessing its deviation from the (null) hypothesis of independence between the pattern and the target. While several algorithms have been proposed to find statistically significant patterns, it remains a computationally demanding task, and for complex patterns such as subgroups, no efficient solution exists. We present FSR, an efficient algorithm to identify statistically significant patterns with rigorous guarantees on the probability of false discoveries. FSR builds on a novel general framework for mining significant patterns that captures some of the most commonly considered patterns, including itemsets, sequential patterns, and subgroups. FSR uses a small number of resampled datasets, obtained by assigning i.i.d. labels to each transaction, to rigorously bound the supremum deviation of a quality statistic measuring the significance of patterns. FSR builds on novel tight bounds on the supremum deviation that require to mine a small number of resampled datasets, while providing a high effectiveness in discovering significant patterns. As a test case, we consider significant subgroup mining, and our evaluation on several real datasets shows that FSR is effective in discovering significant subgroups, while requiring a small number of resampled datasets.

Discovering Significant Sequential Patterns in Data Stream by an Efficient Two-Phase Procedure

Mining Fuzzy Association Rules in Data Streams

Efficient Mining of Closed Sequential Patterns on Stream Sliding Window

Efficient Discovery of Emerging Frequent Patterns in ArbitraryWindows on Data Streams

SeqStream: Mining Closed Sequential Patterns over Stream Sliding Windows

Study on Distributed Sequential Pattern Discovery Algorithm

Mining Scalable Pattern Based on Temporal Logic over Data Streams

Accelerated Frequent Closed Sequential Pattern Mining for Uncertain Data

Fuzzy Frequent Pattern Mining Algorithm Based on Weighted Sliding Window and Type-2 Fuzzy Sets over Medical Data Stream

A New Algorithm of Mining High Utility Sequential Pattern in Streaming Data

State-of-the-art on Frequent Pattern Mining in Data Streams

Mining Sequential Patterns by Pattern-Growth: the PrefixSpan Approach.

Mining Statistically Significant Patterns with High Utility

DELAY: A Lazy Approach for Mining Frequent Patterns over High Speed Data Streams

An Effective Algorithm for Mining Compressed Sequential Patterns

Self-adaptive nonoverlapping sequential pattern mining

Estimation and maintenance of frequent pattern on data streams

Efficient Discovery of Significant Patterns with Few-Shot Resampling

A Two-Phase Approach for Unexpected Pattern Mining.

A Heuristic Method for Unstructured Pattern Management over Data Streams.