Abstract:Bayesian network (BN), a simple graphical notation for conditional independence assertions, is promised to represent the probabilistic relationships between diseases and symptoms. Learning the structure of a Bayesian network classifier (BNC) encodes conditional independence assumption between attributes, which may deteriorate the classification performance. One major approach to mitigate the BNC's primary weakness (the attributes independence assumption) is the locally weighted approach. And this type of approach has been proved to achieve good performance for naive Bayes, a BNC with simple structure. However, we do not know whether or how effective it works for improving the performance of the complex BNC. In this paper, we first do a survey on the complex structure models for BNCs and their improvements, then carry out a systematically experimental analysis to investigate the effectiveness of locally weighted method for complex BNCs, e.g., tree-augmented naive Bayes (TAN), averaged one-dependence estimators AODE and hidden naive Bayes (HNB), measured by classification accuracy (ACC) and the area under the ROC curve ranking (AUC). Experiments and comparisons on 36 benchmark data sets collected from University of California, Irvine (UCI) in Weka system demonstrate that locally weighting technologies just slightly outperforms unweighted complex BNCs on ACC and AUC. In other words, although locally weighting could significantly improve the performance of NB (a BNC with simple structure), it could not work well on BNCs with complex structures. This is because the performance improvements of BNCs are attributed to their structures not the locally weighting.

Learning Balanced Bayesian Classifiers from Labeled and Unlabeled Data

Locally Weighted Learning: How and when Does It Work in Bayesian Networks?

Efficient Heuristics for Learning Bayesian Network from Labeled and Unlabeled Data

Efficient heuristics for learning scalable Bayesian network classifier from labeled and unlabeled data

Learning Bayesian Multinets from Labeled and Unlabeled Data for Knowledge Representation.

Sampled Bayesian Network Classifiers for Class-Imbalance and Cost-Sensitive Learning

Bayesian Network Parameter Learning with Constraint Balance

Semi-supervised Learning for K-Dependence Bayesian Classifiers

Stochastic Optimization for Bayesian Network Classifiers

LMNNB: Two-in-One Imbalanced Classification Approach by Combining Metric Learning and Ensemble Learning

Discriminatory Target Learning: Mining Significant Dependence Relationships from Labeled and Unlabeled Data.

Label-Driven Learning Framework: Towards More Accurate Bayesian Network Classifiers Through Discrimination of High-Confidence Labels

Bayesian Approach to Learn Bayesian Networks Using Data and Constraints.

Towards Deeper Insights into Deep Learning from Imbalanced Data.

Probability Knowledge Acquisition from Unlabeled Instance Based on Dual Learning

To Balance or Not to Balance: A Simple-yet-Effective Approach for Learning with Long-Tailed Distributions

Graph-Based Class-Imbalance Learning With Label Enhancement

A Novel Approach to Fully Representing the Diversity in Conditional Dependencies for Learning Bayesian Network Classifier

An Error-Driven Learning Algorithm for Bayesian Network Classifiers

Learning High-Dependence Bayesian Network Classifier with Robust Topology

MBBNTree Classifier Algorithm Based on Active Learning from Unlabeled Samples