Abstract:It is unpractical to learn the optimal structure of a big Bayesian network (BN) by exhausting the feasible structures, since the number of feasible structures is super exponential on the number of nodes. This paper proposes an approach to layer nodes of a BN by using the conditional independence testing. The parents of a node layer only belong to the layer, or layers who have priority over the layer. When a set of nodes has been layered, the number of feasible structures over the nodes can be remarkably reduced, which makes it possible to learn optimal BN structures for bigger sizes of nodes by accurate algorithms. Integrating the dynamic programming (DP) algorithm with the layering approach, we propose a hybrid algorithm — layered optimal learning (LOL) to learn BN structures. Benefitted by the layering approach, the complexity of the DP algorithm reduces to O(ρ2 n−1 ) from O(n2 n−1 ), where ρ < n. Meanwhile, the memory requirements for storing intermediate results are limited to O(C k#/2 <inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">k#</inf> ) from O(C n/2 <inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">n</inf> ), where k # <n. A case study on learning a standard BN with 50 nodes is conducted. The results demonstrate the superiority of the LOL algorithm, with respect to the Bayesian information criterion (BIC) score criterion, over the hill-climbing, max-min hill-climbing, PC, and three-phrase dependency analysis algorithms.

Efficient heuristics for learning scalable Bayesian network classifier from labeled and unlabeled data

Locally Weighted Learning: How and when Does It Work in Bayesian Networks?

Evolutionary Lazy Learning for Naive Bayes Classification

Efficient Heuristics for Learning Bayesian Network from Labeled and Unlabeled Data

Sparse Bayesian Approach to Fast Learning Network for Multiclassification.

Learning Balanced Bayesian Classifiers from Labeled and Unlabeled Data

Learning High-Dependence Bayesian Network Classifier with Robust Topology

A Novel Bayes Model: Hidden Naive Bayes

Learning Bayesian Multinets from Labeled and Unlabeled Data for Knowledge Representation.

Stochastic Optimization for Bayesian Network Classifiers

A Parallel and Incremental Approach for Data-Intensive Learning of Bayesian Networks

Finding optimal Bayesian networks by a layered learning method

Improving the Naïve Bayes Classifier

Enhancing SNNB with Local Accuracy Estimation and Ensemble Techniques

Hierarchical Independence Thresholding for Learning Bayesian Network Classifiers.

Exploiting the Implicit Independence Assumption for Learning Directed Graphical Models.

Exploring Complex Multivariate Probability Distributions with Simple and Robust Bayesian Network Topology for Classification

SNNB: A Selective Neighborhood Based Naïve Bayes for Lazy Learning.

Survey of Improving Naive Bayes for Classification

Bayesian network model structure based on binary evolutionary algorithm

A Hybrid Method for Learning Multi-Dimensional Bayesian Network Classifiers Based on an Optimization Model