Abstract:Numerous algorithms have been proposed to improve Naive Bayes (NB) by weakening its conditional attribute independence assumption, among which Tree Augmented Naive Bayes (TAN) has demonstrated remarkable classification performance in terms of classification accuracy or error rate, while maintaining efficiency and simplicity. In many real-world applications, however, classification accuracy or error rate is not enough. For example, in direct marketing, we often need to deploy different promotion strategies to customers with different likelihood (class probability) of buying some products. Thus, accurate class probability estimation is often required to make optimal decisions. In this paper, we investigate the class probability estimation performance of TAN in terms of conditional log likelihood (CLL) and present a new algorithm to improve its class probability estimation performance by the spanning TAN classifiers. We call our improved algorithm Averaged Tree Augmented Naive Bayes (ATAN). The experimental results on a large number of UCI datasets published on the main web site of Weka platform show that ATAN significantly outperforms TAN and all the other algorithms used to compare in terms of CLL.

A Selective Tree-Augmented Bayesian Network Classifier Based on Rough Set Theory

Selective Augmented Bayesian Network Classifiers Based on Rough Set Theory

Rough set based decision tree

Learning Robust Bayesian Network Classifiers in the Space of Markov Equivalent Classes

A Smart Design for the TAN Classifier

Tree Augmented Naïve possibilistic network classifier.

SubTree Augmented Naïve Bayesian classifier based on the fuzzy equivalence partition of attribute variables

Directed Tree Algorithm Based on TAN Classifiers

Tree-Augmented Naive Bayes Ensembles

A NEW BAYESIAN TREE CLASSIFIER AND ITS APPLICATION

Adjusting Dependence Relations for Semi-Lazy TAN Classifiers

New method for constructing decision tree based on rough sets theory

Improving Tree Augmented Naive Bayes for Class Probability Estimation

Hierarchical Dependency Constrained Tree Augmented Naive Bayes Classifiers for Hierarchical Feature Spaces

Learning Tree-Augmented Naive Bayesian Network by Reduced Space Requirements

Generalized tree augmented naive bayes

Learning High-Dependence Bayesian Network Classifier with Robust Topology

The Stability of a Restricted Bayesian Network: an Empirical Investigation

A New Hierarchical Redundancy Eliminated Tree Augmented Naive Bayes Classifier for Coping with Gene Ontology-based Features

Structure Extension of Tree-Augmented Naive Bayes

Equivalent Classes of TAN Classifier Structure and Their Application on Learning Algorithm