Abstract:A Bayesian network is an efficient tool to deal with classification problem using probabilistic method.However,automatically identifying high-scoring Bayesian network structures from data is an non-deterministic polynomial-time hard(NP-hard) problem.Fortunately,a restricted Bayesian network serves as a bridge between Bayesian theory and practical applications.Recent work in supervised learning has shown that a surprisingly restricted Bayesian network classifier with strong assumptions of the same number of each conditional variable's parents,such as tree augmented naive bayes(TAN) model,is competitive with state of the art classifiers.This fact raises the question of whether a classifier with less restrictive assumptions could perform even better.In this paper,it tries to set different number of parents for different nodes in the Bayesian network structure.The strength of dependence related to two nodes decides whether there is a link between them.It adopts conditional mutual information testing as the measure method for dependence relationship.This is because conditional mutual information testing can not only measure the dependent strength between two nodes,but also score the performance of a Bayesian network structure.Crucially,this kind of measure has a property of additive decomposition of itself.Using this property,each node can be restricted individually,and the learned Bayesian network structure will be more suitable to the distribution of a dataset.According to the analysis above,a local scoring-search algorithm is proposed,which still based on conditional mutual information theory to build this kind of restricted networks.Experimental results have shown that it is more efficient than most common scoring methods,such as BDeu scoring algorithm,minimum description length(MDL) scoring algorithm,conditional mutual information(CMI) scoring algorithm and TAN algorithm,on 20 datasets obtained from the university of california IV vine(UCI) repository of machine learning databases.

Restricted Bayesian Classification Networks.

Learning Cluster Causal Diagrams: an Information-Theoretic Approach

Bayesian network based semantic image classification with attributed relational graph

A New Restricted Bayesian Network Classifier

Learning Bayesian Networks by Constrained Bayesian Estimation

A local scoring-search algorithm for restricted Bayesian networks structure learning

Locally Weighted Learning: How and when Does It Work in Bayesian Networks?

Bayesian Approach to Learn Bayesian Networks Using Data and Constraints.

Bayesian Network Parameter Learning Using Constraint-Based Data Extension Method

Learning Bayesian Networks Using the Constrained Maximum a Posteriori Probability Method

Learning Causal Bayesian Networks Based on Causality Analysis for Classification

Restricted Bayesian Neural Network

Exploring the Non-Trivial Knowledge Implicit in Test Instance to Fully Represent Unrestricted Bayesian Classifier.

From Undirected Dependence to Directed Causality: A Novel Bayesian Learning Approach

A Novel Approach to Fully Representing the Diversity in Conditional Dependencies for Learning Bayesian Network Classifier

Embedded Bayesian Network Classifiers

Bayesian networks structure learning based on improved BIC scoring

Representing and Inferring Causalities among Classes of Multidimensional Data

The Stability of a Restricted Bayesian Network: an Empirical Investigation

Exploiting the Implicit Independence Assumption for Learning Directed Graphical Models.

High Dimensional Bayesian Network Classification with Network Global-Local Shrinkage Priors