Abstract:Decision trees are particularly promising in symbolic representation and reasoning due to their comprehensible nature, which resembles the hierarchical process of human decision making. However, their drawbacks, caused by the single-tree structure, cannot be ignored. A rigid decision path may cause the majority class to overwhelm other class when dealing with imbalanced data sets, and pruning removes not only superfluous nodes, but also subtrees. The proposed learning algorithm, flexible hybrid decision forest (FHDF), mines information implicated in each instance to form logical rules on the basis of a chain rule of local mutual information, then forms different decision tree structures and decision forests later. The most credible decision path from the decision forest can be selected to make a prediction. Furthermore, functional dependencies (FDs), which are extracted from the whole data set based on association rule analysis, perform embedded attribute selection to remove nodes rather than subtrees, thus helping to achieve different levels of knowledge representation and improve model comprehension in the framework of semi-supervised learning. Naive Bayes replaces the leaf nodes at the bottom of the tree hierarchy, where the conditional independence assumption may hold. This technique reduces the potential for overfitting and overtraining and improves the prediction quality and generalization. Experimental results on UCI data sets demonstrate the efficacy of the proposed approach.

Combining Neural Network, Genetic Algorithm and Symbolic Learning Approach to Discover Knowledge from Databases

The Application of MPC-GEP in Classification Rule Mining

A New Kind of Dynamic Association Rule and Its Mining Algorithms

NeuroRule: A Connectionist Approach to Data Mining

A General Neural Framework for Classification Rule Mining.

Method of Association Rules Mining Based on Genetic Algorithms

On Mining Instance-Centric Classification Rules

A New Approach to Classification Based on Association Rule Mining

Neurosymbolic Methods for Rule Mining

An Optimized Method for Mining Biological Data Multilevel Association Rules

Mining Hierarchical Decision Rules from Hybrid Data with Categorical and Continuous Valued Attributes

Nugget Discovery with a Multi-objective Cultural Algorithm

HARMONY: Efficiently Mining the Best Rules for Classification.

Mining of Multi-Relational Association Rules

Mining insightful classification rules directly and efficiently

NEARM - Natural Language Enhanced Association Rules Mining.

Database mining: a performance perspective

How to Mine Information from Each Instance to Extract an Abbreviated and Credible Logical Rule

Multistrategy Learning Using Genetic Algorithms and Neural Networks for Pattern Classification

Mining Positive and Negative Association Rules from Large Databases

A Study of Classification Algorithm for Data Mining Based on Hybrid Intelligent Systems