Abstract:Bayesian network (BN), a simple graphical notation for conditional independence assertions, is promised to represent the probabilistic relationships between diseases and symptoms. Learning the structure of a Bayesian network classifier (BNC) encodes conditional independence assumption between attributes, which may deteriorate the classification performance. One major approach to mitigate the BNC's primary weakness (the attributes independence assumption) is the locally weighted approach. And this type of approach has been proved to achieve good performance for naive Bayes, a BNC with simple structure. However, we do not know whether or how effective it works for improving the performance of the complex BNC. In this paper, we first do a survey on the complex structure models for BNCs and their improvements, then carry out a systematically experimental analysis to investigate the effectiveness of locally weighted method for complex BNCs, e.g., tree-augmented naive Bayes (TAN), averaged one-dependence estimators AODE and hidden naive Bayes (HNB), measured by classification accuracy (ACC) and the area under the ROC curve ranking (AUC). Experiments and comparisons on 36 benchmark data sets collected from University of California, Irvine (UCI) in Weka system demonstrate that locally weighting technologies just slightly outperforms unweighted complex BNCs on ACC and AUC. In other words, although locally weighting could significantly improve the performance of NB (a BNC with simple structure), it could not work well on BNCs with complex structures. This is because the performance improvements of BNCs are attributed to their structures not the locally weighting.

The Constructing of Bayesian Networks Based on Intelligent Optimization

Locally Weighted Learning: How and when Does It Work in Bayesian Networks?

Hybrid Optimization Algorithm for Bayesian Network Structure Learning

Graph Bayesian Optimization: Algorithms, Evaluations and Applications.

New Algorithm for Constructing Bayesian Network Structures from Data

A Novel Framework of Graph Bayesian Optimization and Its Applications to Real-World Network Analysis

Bayesian Network Structure Learning Based on Restricted Particle Swarm Optimization

Constructing DBN Structure Based on BOA

An Improved Particle Swarm Optimization Algorithm for Bayesian Network Structure Learning via Local Information Constraint

Bayesian Approach to Learn Bayesian Networks Using Data and Constraints.

Learning Bayesian Networks Using the Constrained Maximum a Posteriori Probability Method

A Novel Discrete Particle Swarm Optimization Algorithm for Solving Bayesian Network Structures Learning Problem.

Improved Bayesian Optimization Algorithm Incorporated Local Structure Learning

Deep Bayesian Optimization on Attributed Graphs

Learning-Bayesian Network Structure Based On Synergetics

Improved Local Search with Momentum for Bayesian Networks Structure Learning

Learning Dynamic Bayesian Networks Structure Based on Bayesian Optimization Algorithm

Learning Bayesian Networks in the Space of Structures by a Hybrid Optimization Algorithm.

Bayesian Optimisation of Functions on Graphs

Graphical Model Construction Based on Evolutionary Algorithms

Structural Learning of Bayesian Networks by Bacterial Foraging Optimization