Abstract:Bayesian network (BN), a simple graphical notation for conditional independence assertions, is promised to represent the probabilistic relationships between diseases and symptoms. Learning the structure of a Bayesian network classifier (BNC) encodes conditional independence assumption between attributes, which may deteriorate the classification performance. One major approach to mitigate the BNC's primary weakness (the attributes independence assumption) is the locally weighted approach. And this type of approach has been proved to achieve good performance for naive Bayes, a BNC with simple structure. However, we do not know whether or how effective it works for improving the performance of the complex BNC. In this paper, we first do a survey on the complex structure models for BNCs and their improvements, then carry out a systematically experimental analysis to investigate the effectiveness of locally weighted method for complex BNCs, e.g., tree-augmented naive Bayes (TAN), averaged one-dependence estimators AODE and hidden naive Bayes (HNB), measured by classification accuracy (ACC) and the area under the ROC curve ranking (AUC). Experiments and comparisons on 36 benchmark data sets collected from University of California, Irvine (UCI) in Weka system demonstrate that locally weighting technologies just slightly outperforms unweighted complex BNCs on ACC and AUC. In other words, although locally weighting could significantly improve the performance of NB (a BNC with simple structure), it could not work well on BNCs with complex structures. This is because the performance improvements of BNCs are attributed to their structures not the locally weighting.

A New Hybrid Method for Learning Bayesian Networks: Separation and Reunion.

A Comprehensively Improved Hybrid Algorithm for Learning Bayesian Networks: Multiple Compound Memory Erasing

Locally Weighted Learning: How and when Does It Work in Bayesian Networks?

Learning in a hybrid Bayesian network structure for causal analysis

Partitioned hybrid learning of Bayesian network structures

An Experimental Comparison of Hybrid Algorithms for Bayesian Network Structure Learning

An efficient skeleton learning approach-based hybrid algorithm for identifying Bayesian network structure

A survey of Bayesian Network structure learning

Bayesian Network Structure Learning Using Chaos Hybrid Genetic Algorithm

Learning the structure of Bayesian networks with ancestral and/or heuristic partition

Structure Learning for Hybrid Bayesian Networks

Efficient heuristics for learning scalable Bayesian network classifier from labeled and unlabeled data

Continuity approximation in hybrid Bayesian networks structure learning

Learning hybrid Bayesian network based on divide and conquer strategy

Hybrid Incremental Learning Algorithms for Bayesian Network Structures

An efficient Bayesian network structure learning algorithm based on structural information

An Improved Particle Swarm Optimization Algorithm for Bayesian Network Structure Learning via Local Information Constraint

Fast & Efficient Learning of Bayesian Networks from Data: Knowledge Discovery and Causality

Efficient Heuristics for Learning Bayesian Network from Labeled and Unlabeled Data

A Method for Learning Bayesian Networks by Using Immune Binary Particle Swarm Optimization.

Comparing Bayesian Network Classifiers