Abstract:Bayesian network (BN), a simple graphical notation for conditional independence assertions, is promised to represent the probabilistic relationships between diseases and symptoms. Learning the structure of a Bayesian network classifier (BNC) encodes conditional independence assumption between attributes, which may deteriorate the classification performance. One major approach to mitigate the BNC's primary weakness (the attributes independence assumption) is the locally weighted approach. And this type of approach has been proved to achieve good performance for naive Bayes, a BNC with simple structure. However, we do not know whether or how effective it works for improving the performance of the complex BNC. In this paper, we first do a survey on the complex structure models for BNCs and their improvements, then carry out a systematically experimental analysis to investigate the effectiveness of locally weighted method for complex BNCs, e.g., tree-augmented naive Bayes (TAN), averaged one-dependence estimators AODE and hidden naive Bayes (HNB), measured by classification accuracy (ACC) and the area under the ROC curve ranking (AUC). Experiments and comparisons on 36 benchmark data sets collected from University of California, Irvine (UCI) in Weka system demonstrate that locally weighting technologies just slightly outperforms unweighted complex BNCs on ACC and AUC. In other words, although locally weighting could significantly improve the performance of NB (a BNC with simple structure), it could not work well on BNCs with complex structures. This is because the performance improvements of BNCs are attributed to their structures not the locally weighting.

Bernoulli Neural Network with Weights Directly Determined and with the Number of Hidden- Layer Neurons Automatically Determined

Euler Neural Network with Its Weight-Direct-Determination and Structure-Automatic-Determination Algorithms

Weights and Structure Determination of 3-Input Bernoulli Polynomial Neural Net

Padé Rational Neural Network and Its Weights-Direct-Determination Method

Improve Feed-Forward Neural Network for Weights Direct Determination: a Jacobi-Polynomial Example

Locally Weighted Learning: How and when Does It Work in Bayesian Networks?

Weights and Structure Determination Method of Multiple-Input Sigmoid Activation Function Neural Network

Weights and Structure Determination of Feed-Forward Two-Input Neural Network Activated by Chebyshev Polynomials of Class 2

On Weights and Structure Determination of Hermite-interpolation Neural Network

Weights immediate determination for feed-forward neural network with Legendre orthogonal basis function

A Chebyshev Orthogonal Basis Neural Network with Direct Weight Determination

Twice-Pruning Aided WASD Neuronet of Bernoulli-Polynomial Type with Extension to Robust Classification

A Weights-Directly-determined Simple Neural Network for Nonlinear System Identification

A Gegenbauer Neural Network with Regularized Weights Direct Determination for Classification

RBF Neural Network Classifier with Weights and Structure Determination Method

Unipolar Sigmoid Neural Network Classifier Based on Weights and Structure Determination Method

Growing Algorithm of Laguerre Orthogonal Basis Neural Network with Weights Directly Determined

WASD neural network activated by bipolar sigmoid functions together with subsequent iterations

MISO Multivariate Generalized Polynomials Neural Network and Its Weights-Direct-Determination

Weights-direct-determination and Structure-Adaptive-determination of Feed-Forward Neural Network Activated with the 2nd -Class Chebyshev Orthogonal Polynomials

Sine Neural Network (SNN) with Double-Stage Weights and Structure Determination (DS-WASD)