Abstract:Bayesian network (BN), a simple graphical notation for conditional independence assertions, is promised to represent the probabilistic relationships between diseases and symptoms. Learning the structure of a Bayesian network classifier (BNC) encodes conditional independence assumption between attributes, which may deteriorate the classification performance. One major approach to mitigate the BNC's primary weakness (the attributes independence assumption) is the locally weighted approach. And this type of approach has been proved to achieve good performance for naive Bayes, a BNC with simple structure. However, we do not know whether or how effective it works for improving the performance of the complex BNC. In this paper, we first do a survey on the complex structure models for BNCs and their improvements, then carry out a systematically experimental analysis to investigate the effectiveness of locally weighted method for complex BNCs, e.g., tree-augmented naive Bayes (TAN), averaged one-dependence estimators AODE and hidden naive Bayes (HNB), measured by classification accuracy (ACC) and the area under the ROC curve ranking (AUC). Experiments and comparisons on 36 benchmark data sets collected from University of California, Irvine (UCI) in Weka system demonstrate that locally weighting technologies just slightly outperforms unweighted complex BNCs on ACC and AUC. In other words, although locally weighting could significantly improve the performance of NB (a BNC with simple structure), it could not work well on BNCs with complex structures. This is because the performance improvements of BNCs are attributed to their structures not the locally weighting.

LOCAL MODELS—THE KEY TO BOOSTING STABLE LEARNERS SUCCESSFULLY

Boosting Support Vector Machines Successfully.

Support Vector Machines Ensemble With Optimizing Weights By Genetic Algorithm

Boosting the Partial Least Square Algorithm for Regression Modelling

A Local Online Learning Approach for Non-linear Data.

Locally Weighted Learning: How and when Does It Work in Bayesian Networks?

Feature-subspace Aggregating: Ensembles for Stable and Unstable Learners

Effective Boosting of Naïve Bayesian Classifiers by Local Accuracy Estimation

Local Boosting for Weakly-Supervised Learning

Automating localized learning for cardinality estimation based on XGBoost

A Method to Boost Support Vector Machines

A Method to Boost Naïve Bayesian Classifiers

Boosting Local Naïve Bayesian Rules

Online Local Boosting: Improving Performance in Online Decision Trees

To Boost or not to Boost: On the Limits of Boosted Neural Networks

Privacy-Preserving Boosting in the Local Setting

Saving Evaluation Time for the Decision Function in Boosting: Representation and Reordering Base Learner.

Enhancing SNNB with Local Accuracy Estimation and Ensemble Techniques

BoostTree and BoostForest for Ensemble Learning

Approximation Stability And Boosting

Designing Ensemble Learning Algorithms Using Kernel Methods