Abstract:Classification can be regarded as dividing the data space into decision regions separated by decision boundaries. In this paper we analyze decision tree algorithms and the NBTree algorithm from this perspective. Thus, a decision tree can be regarded as a classifier tree, in which each classifier on a non-root node is trained in decision regions of the classifier on the parent node. Meanwhile, the NBTree algorithm, which generates a classifier tree with the C4.5 algorithm and the naive Bayes classifier as the root and leaf classifiers respectively, can also be regarded as training naive Bayes classifiers in decision regions of the C4.5 algorithm. We propose a second division (SD) algorithm and three soft second division (SD-soft) algorithms to train classifiers in decision regions of the naive Bayes classifier. These four novel algorithms all generate two-level classifier trees with the naive Bayes classifier as root classifiers. The SD and three SD-soft algorithms can make good use of both the information contained in instances near decision boundaries, and those that may be ignored by the naive Bayes classifier. Finally, we conduct experiments on 30 data sets from the UC Irvine (UCI) repository. Experiment results show that the SD algorithm can obtain better generalization abilities than the NBTree and the averaged one-dependence estimators (AODE) algorithms when using the C4.5 algorithm and support vector machine (SVM) as leaf classifiers. Further experiments indicate that our three SD-soft algorithms can achieve better generalization abilities than the SD algorithm when argument values are selected appropriately.

Equivalent Classes of TAN Classifier Structure and Their Application on Learning Algorithm

Learning to Detect Traffic Incidents from Data Based on Tree Augmented Naive Bayesian Classifiers

Structure Extension of Tree-Augmented Naive Bayes

Learning Tree-Augmented Naive Bayesian Network by Reduced Space Requirements

Structure Extension Of Tan Through Greedy Search

Hierarchical Dependency Constrained Tree Augmented Naive Bayes Classifiers for Hierarchical Feature Spaces

Tree Augmented Naïve possibilistic network classifier.

Tree-Augmented Naive Bayes Ensembles

Comparison of Two Learning Methods of the Tree Augmented Nave Bayesian Network Classifier

A Hybrid Bayesian Network Structure Learning Algorithm in Equivalence Class Space

Improving Classification Performance By Combining Multiple Tan Classifiers

An active TAN classifier based on vote entropy-maximum entropy of QBC

An Algorithm for Learning the Markov Equivalence Classes of the Bayesian Network

Generalized tree augmented naive bayes

An improved nearest neighbor searching method for classification problems

Improving Naive Bayes Classifier by Dividing Its Decision Regions

Learning High-Dependence Bayesian Network Classifier with Robust Topology

Integrating TANBN with cost sensitive classification algorithm for imbalanced data in medical diagnosis

A Simple yet Effective Method for Graph Classification

A New Hierarchical Redundancy Eliminated Tree Augmented Naive Bayes Classifier for Coping with Gene Ontology-based Features

Application of Improved Decision Tree Algorithm