Abstract:Decision trees are particularly promising in symbolic representation and reasoning due to their comprehensible nature, which resembles the hierarchical process of human decision making. However, their drawbacks, caused by the single-tree structure, cannot be ignored. A rigid decision path may cause the majority class to overwhelm other class when dealing with imbalanced data sets, and pruning removes not only superfluous nodes, but also subtrees. The proposed learning algorithm, flexible hybrid decision forest (FHDF), mines information implicated in each instance to form logical rules on the basis of a chain rule of local mutual information, then forms different decision tree structures and decision forests later. The most credible decision path from the decision forest can be selected to make a prediction. Furthermore, functional dependencies (FDs), which are extracted from the whole data set based on association rule analysis, perform embedded attribute selection to remove nodes rather than subtrees, thus helping to achieve different levels of knowledge representation and improve model comprehension in the framework of semi-supervised learning. Naive Bayes replaces the leaf nodes at the bottom of the tree hierarchy, where the conditional independence assumption may hold. This technique reduces the potential for overfitting and overtraining and improves the prediction quality and generalization. Experimental results on UCI data sets demonstrate the efficacy of the proposed approach.

Rule Acquisition in Generalized One-Sided Decision Systems.

Attribute reduction and rule acquisition of formal decision context based on two new kinds of decision rules

Cognitive Computing and Rule Extraction in Generalized One-sided Formal Contexts

Density-Based Mining of Quantitative Association Rules

Hierarchical sequential three-way decision model

Rule acquisition in generalized multi-scale information systems with multi-scale decisions

Generalized multidimensional association rules

Association Rules Mining Based on the Discriminative Concept Lattice

Mining Hierarchical Decision Rules from Hybrid Data with Categorical and Continuous Valued Attributes

From Intra-Transaction to Generalized Inter-Transaction: Landscaping Multidimensional Contexts in Association Rule Mining

Rules Extraction from Multiple Decisions Ordered Information Tables

The Connections Between Attribute-Induced and Object-Induced Decision Rules in Incomplete Formal Contexts

Negative Rules and Reduction in Rough Sets Based on Similarity Relation

How to Mine Information from Each Instance to Extract an Abbreviated and Credible Logical Rule

Simple Association Rules (SAR) and the SAR-based Rule Discovery

Dominance-based Rule Acquisition of Multi-Scale Single-Valued Neutrosophic Decision System

A rule-general abductive learning by rough sets

A Dynamic Approach Based on Apriorilike Algorithm for Mining Association Rules

A Rule Extraction Algorithm Based On Attribute Importance

Mining of Multi-Relational Association Rules

Mining Generalized Association Rules with Fuzzy Taxonomic Structures