Abstract:Significant pattern mining is a fundamental task in mining transactional data, requiring to identify patterns significantly associated with the value of a given feature, the target. In several applications, such as biomedicine, basket market analysis, and social networks, the goal is to discover patterns whose association with the target is defined with respect to an underlying population, or process, of which the dataset represents only a collection of observations, or samples. A natural way to capture the association of a pattern with the target is to consider its statistical significance, assessing its deviation from the (null) hypothesis of independence between the pattern and the target. While several algorithms have been proposed to find statistically significant patterns, it remains a computationally demanding task, and for complex patterns such as subgroups, no efficient solution exists. We present FSR, an efficient algorithm to identify statistically significant patterns with rigorous guarantees on the probability of false discoveries. FSR builds on a novel general framework for mining significant patterns that captures some of the most commonly considered patterns, including itemsets, sequential patterns, and subgroups. FSR uses a small number of resampled datasets, obtained by assigning i.i.d. labels to each transaction, to rigorously bound the supremum deviation of a quality statistic measuring the significance of patterns. FSR builds on novel tight bounds on the supremum deviation that require to mine a small number of resampled datasets, while providing a high effectiveness in discovering significant patterns. As a test case, we consider significant subgroup mining, and our evaluation on several real datasets shows that FSR is effective in discovering significant subgroups, while requiring a small number of resampled datasets.

Reducing False Discoveries in Statistically-Significant Regional-Colocation Mining: A Summary of Results

Mining Regional Co-Location Patterns with Knng

Discovery of Regional Co-location Patterns with k-Nearest Neighbor Graph.

Mining Spatial Co-Location Patterns With Dynamic Neighborhood Constraint

Spatial Co-Location Pattern Discovery Without Thresholds

An approach based on maximal cliques and multi-density clustering for regional co-location pattern mining

Towards Statistically Significant Taxonomy Aware Co-location Pattern Detection

Incremental Maintenance of Discovered Spatial Colocation Patterns

A Novel Algorithm for Efficiently Mining Spatial Multi-level Co-location Patterns

CODEM: A Novel Spatial Co-location and De-location Patterns Mining Algorithm

RCP Mining: Towards the Summarization of Spatial Co-location Patterns.

Maximal Instance Algorithm for Fast Mining of Spatial Co-Location Patterns

Rethinking the null hypothesis in significant colocation pattern mining of spatial flows

Detecting Statistically Significant Geographical Anomalous Regions from Spatial Sampling Points by Coupling Gaussian Function and Multidirectional Optimization.

Significant spatial co-distribution pattern discovery

Mining Co-Locations From Continuously Distributed Uncertain Spatial Data

Spatial Co-Location Pattern Mining Based on the Improved Density Peak Clustering and the Fuzzy Neighbor Relationship.

Mining Statistically Significant Communities from Weighted Networks

Mining at Most Top-K% Spatio-temporal Outlier Based Context: A Summary of Results

ACOMCD: A multiple cluster detection algorithm based on the spatial scan statistic and ant colony optimization

Efficient Discovery of Significant Patterns with Few-Shot Resampling