Abstract:Pattern discovery is a machine learning technique that aims to find sets of items, subsequences, or substructures that are present in a dataset with a higher frequency value than a manually set threshold. This process helps to identify recurring patterns or relationships within the data, allowing for valuable insights and knowledge extraction. In this work, we propose Information Gained Subgroup Discovery (IGSD), a new SD algorithm for pattern discovery that combines Information Gain (IG) and Odds Ratio (OR) as a multi-criteria for pattern selection. The algorithm tries to tackle some limitations of state-of-the-art SD algorithms like the need for fine-tuning of key parameters for each dataset, usage of a single pattern search criteria set by hand, usage of non-overlapping data structures for subgroup space exploration, and the impossibility to search for patterns by fixing some relevant dataset variables. Thus, we compare the performance of IGSD with two state-of-the-art SD algorithms: FSSD and SSD++. Eleven datasets are assessed using these algorithms. For the performance evaluation, we also propose to complement standard SD measures with IG, OR, and p-value. Obtained results show that FSSD and SSD++ algorithms provide less reliable patterns and reduced sets of patterns than IGSD algorithm for all datasets considered. Additionally, IGSD provides better OR values than FSSD and SSD++, stating a higher dependence between patterns and targets. Moreover, patterns obtained for one of the datasets used, have been validated by a group of domain experts. Thus, patterns provided by IGSD show better agreement with experts than patterns obtained by FSSD and SSD++ algorithms. These results demonstrate the suitability of the IGSD as a method for pattern discovery and suggest that the inclusion of non-standard SD metrics allows to better evaluate discovered patterns.

Research of the Subgroup Discovery Algorithm NMEEF-SD

A Subgroup Discovery Algorithm Based on Genetic Fuzzy Systems

Improved Understanding on the Searching Behavior of Nsga-Ii Operators Using Run-Time Measure Metrics with Application to Water Distribution System Design Problems

A new algorithm for Subgroup Set Discovery based on Information Gain

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

Mining Java Memory Errors using Subjective Interesting Subgroups with Hierarchical Targets

Enhancing Moea/D with Uniform Population Initialization, Weight Vector Design and Adjustment Using Uniform Design

Subgroups: A Python library for Subgroup Discovery

Expert-Guided Subgroup Discovery: Methodology and Application

An Evolutionary Computational Method for N-Connection Subgraph Discovery

On Neighborhood Exploration And Subproblem Exploitation In Decomposition Based Multiobjective Evolutionary Algorithms

Hybrid Non-dominated Sorting Differential Evolutionary Algorithm with Nelder-Mead

A Differential Evolution Algorithm With Adaptive Niching and K-Means Operation for Data Clustering

Dynamic clustering using multi-objective evolutionary algorithm

Differential evolution algorithm with multi-population cooperation and multi-strategy integration

A Novel Genetic Algorithm for Subspace Based Subclasssifier Selection

Mining association rules in big data with NGEP

A Novel Spectral Ensemble Clustering Algorithm Based on Social Group Migratory Behavior and Emotional Preference

Multi-objective unsupervised feature selection algorithm utilizing redundancy measure and negative epsilon-dominance for fault diagnosis.

Diversity-Optimized Group Extraction in Social Networks

Novel soft subspace clustering with multi-objective evolutionary approach for high-dimensional data