Abstract:Bayesian network (BN), a simple graphical notation for conditional independence assertions, is promised to represent the probabilistic relationships between diseases and symptoms. Learning the structure of a Bayesian network classifier (BNC) encodes conditional independence assumption between attributes, which may deteriorate the classification performance. One major approach to mitigate the BNC's primary weakness (the attributes independence assumption) is the locally weighted approach. And this type of approach has been proved to achieve good performance for naive Bayes, a BNC with simple structure. However, we do not know whether or how effective it works for improving the performance of the complex BNC. In this paper, we first do a survey on the complex structure models for BNCs and their improvements, then carry out a systematically experimental analysis to investigate the effectiveness of locally weighted method for complex BNCs, e.g., tree-augmented naive Bayes (TAN), averaged one-dependence estimators AODE and hidden naive Bayes (HNB), measured by classification accuracy (ACC) and the area under the ROC curve ranking (AUC). Experiments and comparisons on 36 benchmark data sets collected from University of California, Irvine (UCI) in Weka system demonstrate that locally weighting technologies just slightly outperforms unweighted complex BNCs on ACC and AUC. In other words, although locally weighting could significantly improve the performance of NB (a BNC with simple structure), it could not work well on BNCs with complex structures. This is because the performance improvements of BNCs are attributed to their structures not the locally weighting.

Adjusting Dependence Relations for Semi-Lazy TAN Classifiers

A Smart Design for the TAN Classifier

Selective Augmented Bayesian Network Classifiers Based on Rough Set Theory

Structure Extension Of Tan Through Greedy Search

Hierarchical Dependency Constrained Tree Augmented Naive Bayes Classifiers for Hierarchical Feature Spaces

A Selective Tree-Augmented Bayesian Network Classifier Based on Rough Set Theory

Not so naive Bayesian classification

Structure Extension of Tree-Augmented Naive Bayes

Generalized tree augmented naive bayes

Improving Tree Augmented Naive Bayes for Class Probability Estimation

Tree Augmented Naïve possibilistic network classifier.

Not So Naive Bayes: Aggregating One-Dependence Estimators

Learning Robust Bayesian Network Classifiers in the Space of Markov Equivalent Classes

Locally Weighted Learning: How and when Does It Work in Bayesian Networks?

SubTree Augmented Naïve Bayesian classifier based on the fuzzy equivalence partition of attribute variables

Directed Tree Algorithm Based on TAN Classifiers

Tree-Augmented Naive Bayes Ensembles

Learning High-Dependence Bayesian Network Classifier with Robust Topology

A Discriminative Learning Method of TAN Classifier

Improving Classification Performance By Combining Multiple Tan Classifiers

A New Hierarchical Redundancy Eliminated Tree Augmented Naive Bayes Classifier for Coping with Gene Ontology-based Features