Abstract:Bayesian network (BN), a simple graphical notation for conditional independence assertions, is promised to represent the probabilistic relationships between diseases and symptoms. Learning the structure of a Bayesian network classifier (BNC) encodes conditional independence assumption between attributes, which may deteriorate the classification performance. One major approach to mitigate the BNC's primary weakness (the attributes independence assumption) is the locally weighted approach. And this type of approach has been proved to achieve good performance for naive Bayes, a BNC with simple structure. However, we do not know whether or how effective it works for improving the performance of the complex BNC. In this paper, we first do a survey on the complex structure models for BNCs and their improvements, then carry out a systematically experimental analysis to investigate the effectiveness of locally weighted method for complex BNCs, e.g., tree-augmented naive Bayes (TAN), averaged one-dependence estimators AODE and hidden naive Bayes (HNB), measured by classification accuracy (ACC) and the area under the ROC curve ranking (AUC). Experiments and comparisons on 36 benchmark data sets collected from University of California, Irvine (UCI) in Weka system demonstrate that locally weighting technologies just slightly outperforms unweighted complex BNCs on ACC and AUC. In other words, although locally weighting could significantly improve the performance of NB (a BNC with simple structure), it could not work well on BNCs with complex structures. This is because the performance improvements of BNCs are attributed to their structures not the locally weighting.

Evolutionary Lazy Learning for Naive Bayes Classification

Sparse Bayesian Approach to Fast Learning Network for Multiclassification.

Locally Weighted Learning: How and when Does It Work in Bayesian Networks?

SNNB: A Selective Neighborhood Based Naïve Bayes for Lazy Learning.

A Technique For Improving The Performance Of Naive Bayes Text Classification

Efficient heuristics for learning scalable Bayesian network classifier from labeled and unlabeled data

Differential evolutionary Bayesian classifier

A Batch Inheritance Extreme Learning Machine Algorithm Based on Regular Optimization

Enhancing SNNB with Local Accuracy Estimation and Ensemble Techniques

Locally Weighted Learning for Naive Bayes Classifier

A Study of Selective Neighborhood-Based Nai"ve Bayes for Efficient Lazy Learning.

Learning Lazy Rules To Improve The Performance Of Classifiers

Learning semi-lazy Bayesian network classifier under the c.i.i.d assumption

A Novel Text Classification Algorithm Based on Naïve Bayes and KL-Divergence

Learning Bayesian Networks From Data: An Efficient Approach Based On Extended Evolutionary Programming

Learning Lazy Rules to Improve

Efficient Heuristics for Learning Bayesian Network from Labeled and Unlabeled Data

Network-based Naive Bayes Model for Social Network

Neural Network Ensemble With Evolutionary Algorithm for Highly Imbalanced Classification

Lazy Learning Based Double Layer Nave Bayesian Classifier

Learning Bayesian Networks Structures Based on Extending Evolutionary Programming