Abstract:Bayesian network (BN), a simple graphical notation for conditional independence assertions, is promised to represent the probabilistic relationships between diseases and symptoms. Learning the structure of a Bayesian network classifier (BNC) encodes conditional independence assumption between attributes, which may deteriorate the classification performance. One major approach to mitigate the BNC's primary weakness (the attributes independence assumption) is the locally weighted approach. And this type of approach has been proved to achieve good performance for naive Bayes, a BNC with simple structure. However, we do not know whether or how effective it works for improving the performance of the complex BNC. In this paper, we first do a survey on the complex structure models for BNCs and their improvements, then carry out a systematically experimental analysis to investigate the effectiveness of locally weighted method for complex BNCs, e.g., tree-augmented naive Bayes (TAN), averaged one-dependence estimators AODE and hidden naive Bayes (HNB), measured by classification accuracy (ACC) and the area under the ROC curve ranking (AUC). Experiments and comparisons on 36 benchmark data sets collected from University of California, Irvine (UCI) in Weka system demonstrate that locally weighting technologies just slightly outperforms unweighted complex BNCs on ACC and AUC. In other words, although locally weighting could significantly improve the performance of NB (a BNC with simple structure), it could not work well on BNCs with complex structures. This is because the performance improvements of BNCs are attributed to their structures not the locally weighting.

Weighted model counting with conditional weights for Bayesian networks

Open-Universe Weighted Model Counting

Gaussian mixture density modeling and decomposition with weighted likelihood

Learning to Reason: Leveraging Neural Networks for Approximate DNF Counting

Locally Weighted Learning: How and when Does It Work in Bayesian Networks?

Measure Theoretic Weighted Model Integration

ADDMC: Weighted Model Counting with Algebraic Decision Diagrams

Approximate Weighted First-Order Model Counting: Exploiting Fast Approximate Model Counters and Symmetry

Exploiting Structure in Weighted Model Counting Approaches to Probabilistic Inference

Explanation-Based Approximate Weighted Model Counting for Probabilistic Logics

Weighted Positive Binary Decision Diagrams for Exact Probabilistic Inference

Bayesian mixtures of common factor analyzers: Model, variational inference, and applications

Weighted Model Counting with Twin-Width

Enhancing SMT-based Weighted Model Integration by structure awareness

Lifted Algorithms for Symmetric Weighted First-Order Model Sampling

On the Approximability of Weighted Model Integration on DNF Structures

Monte Carlo Anti-Differentiation for Approximate Weighted Model Integration

A Vine-Copula Based Adaptive Mcmc Sampler for Efficient Inference of Dynamical Systems

The G-Wishart Weighted Proposal Algorithm: Efficient Posterior Computation for Gaussian Graphical Models

Modeling and Change Detection for Count-Weighted Multilayer Networks