Abstract:Of numerous proposals to refine naive Bayes by weakening its attribute independence assumption, averaged one-dependence estimators (AODE) has been shown to be able to achieve significantly higher classification accuracy at a moderate cost in classification efficiency. However, all one-dependence estimators (ODEs) in AODE have the same weights and are treated equally. To address this issue, model weighting, which assigns discriminate weights to ODEs and then linearly combine their probability estimates, has been proved to be an efficient and effective approach. Most information-theoretic weighting metrics, including mutual information, Kullback-Leibler measure and the information gain, place more emphasis on the correlation between root attribute (value) and class variable. We argue that the topology of each ODE can be divided into a set of local directed acyclic graphs (DAGs) based on the independence assumption, and multivariate mutual information is introduced to measure the extent to which the DAGs fit data. Based on this premise, in this study we propose a novel weighted AODE algorithm, called AWODE, that adaptively selects weights to alleviate the independence assumption and make the learned probability distribution fit the instance. The proposed approach is validated on 40 benchmark datasets from UCI machine learning repository. The experimental results reveal that, AWODE achieves bias-variance trade-off and is a competitive alternative to single-model Bayesian learners (such as TAN and KDB) and other weighted AODEs (such as WAODE).

Averaged One-Dependence Decision Trees Ensemble Algorithm

Averaged Tree-Augmented One-Dependence Estimators

Weighted One-Dependence Forests Classifier.

Self-Adaptive Attribute Value Weighting for Averaged One-Dependence Estimators.

Alleviating the independence assumptions of averaged one-dependence estimators by model weighting

Attribute Value Weighted Average of One-Dependence Estimators

Attribute Value Weighted Averaged One-Dependence Estimators with Kullback–Leibler Divergence

Extracting Credible Dependencies for Averaged One-Dependence Estimator Analysis

Alleviating the Attribute Conditional Independence and I.I.D. Assumptions of Averaged One-Dependence Estimator by Double Weighting

K-Dependence Bayesian Classifier Ensemble

MTForest: Ensemble Decision Trees based on Multi-Task Learning

Semi-supervised Weighting for Averaged One-Dependence Estimators

Model Weighting for One-Dependence Estimators by Measuring the Independence Assumptions

A New Rotation Forest Ensemble Algorithm

Parameter Estimation in Semi-Random Decision Tree Ensembling on Streaming Data

Boosting-Based Sequential Meta-Tree Ensemble Construction for Improved Decision Trees

Tree-Augmented Naive Bayes Ensembles

Inherently Interpretable Tree Ensemble Learning

Structural Diversity for Decision Tree Ensemble Learning

Learning High-Dependence Bayesian Network Classifier with Robust Topology

A generalized decision tree ensemble based on the NeuralNetworks architecture: Distributed Gradient Boosting Forest (DGBF)