Abstract:Decision trees are particularly promising in symbolic representation and reasoning due to their comprehensible nature, which resembles the hierarchical process of human decision making. However, their drawbacks, caused by the single-tree structure, cannot be ignored. A rigid decision path may cause the majority class to overwhelm other class when dealing with imbalanced data sets, and pruning removes not only superfluous nodes, but also subtrees. The proposed learning algorithm, flexible hybrid decision forest (FHDF), mines information implicated in each instance to form logical rules on the basis of a chain rule of local mutual information, then forms different decision tree structures and decision forests later. The most credible decision path from the decision forest can be selected to make a prediction. Furthermore, functional dependencies (FDs), which are extracted from the whole data set based on association rule analysis, perform embedded attribute selection to remove nodes rather than subtrees, thus helping to achieve different levels of knowledge representation and improve model comprehension in the framework of semi-supervised learning. Naive Bayes replaces the leaf nodes at the bottom of the tree hierarchy, where the conditional independence assumption may hold. This technique reduces the potential for overfitting and overtraining and improves the prediction quality and generalization. Experimental results on UCI data sets demonstrate the efficacy of the proposed approach.

Permanent State Reduction: Motivations, Results, and By-Products

Dynamic Split-point Selection Method for Decision Tree Evolved by Gene Expression Programming

Discourse parsing of sociology dissertation abstracts using decision tree induction

bsnsing: A decision tree induction method based on recursive optimal boolean rule composition

Threads of Subtlety: Detecting Machine-Generated Texts Through Discourse Motifs

Grammar induction by MDL-based distributional classification

An Inductive Method with Genetic Algorithm for Learning Phrase-Structure-rule of Natural Language

How to Mine Information from Each Instance to Extract an Abbreviated and Credible Logical Rule

Automatic Disambiguation of French Discourse Connectives

CLUTRR: A Diagnostic Benchmark for Inductive Reasoning from Text

Greedy Algorithm for Inference of Decision Trees from Decision Rule Systems

Statistical Decision-Tree Models for Parsing

"Oh LLM, I'm Asking Thee, Please Give Me a Decision Tree": Zero-Shot Decision Tree Induction and Embedding with Large Language Models

End-to-end Learning of Deterministic Decision Trees

DECIDER: A Dual-System Rule-Controllable Decoding Framework for Language Generation

Indecision Trees: Learning Argument-Based Reasoning under Quantified Uncertainty

Decision tree modeling using R

On Detecting Borrowing

Induction of a Novel Hybrid Decision Forest Model Based on Information Theory.

Inductive Bias and Language Expressivity in Emergent Communication

Evaluating the Relative Importance of Wordhood Cues Using Statistical Learning