Exploring Complex Multivariate Probability Distributions with Simple and Robust Bayesian Network Topology for Classification

Lanni Wang,Limin Wang,Lu Guo,Qilong Li,Xiongfei Li
DOI: https://doi.org/10.1007/s10489-023-05098-y
IF: 5.3
2023-01-01
Applied Intelligence
Abstract:Bayesian network classifier (BNC) allows efficient and effective inference under condition of uncertainty for classification, and it depicts the interdependencies among random variables using directed acyclic graph (DAG). However, learning an optimal BNC is NP-hard, and complicated DAGs may lead to biased estimates of multivariate probability distributions and subsequent degradation in classification performance. In this study, we suggest using the entropy function as the scoring metric, and then apply greedy search strategy to improve the fitness of learned DAG to training data at each iteration. The proposed algorithm, called One + Bayesian Classifier (O ^+ BC), can represent high-dependence relationships in its robust DAG with a limited number of directed edges. We compare the performance of O ^+ BC with other six state-of-the-art single and ensemble BNCs. The experimental results reveal that O ^+ BC demonstrates competitive or superior performance in terms of zero-one loss, bias-variance decomposition, Friedman and Nemenyi tests.
What problem does this paper attempt to address?