Abstract:It is unpractical to learn the optimal structure of a big Bayesian network (BN) by exhausting the feasible structures, since the number of feasible structures is super exponential on the number of nodes. This paper proposes an approach to layer nodes of a BN by using the conditional independence testing. The parents of a node layer only belong to the layer, or layers who have priority over the layer. When a set of nodes has been layered, the number of feasible structures over the nodes can be remarkably reduced, which makes it possible to learn optimal BN structures for bigger sizes of nodes by accurate algorithms. Integrating the dynamic programming (DP) algorithm with the layering approach, we propose a hybrid algorithm — layered optimal learning (LOL) to learn BN structures. Benefitted by the layering approach, the complexity of the DP algorithm reduces to O(ρ2 n−1 ) from O(n2 n−1 ), where ρ < n. Meanwhile, the memory requirements for storing intermediate results are limited to O(C k#/2 <inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">k#</inf> ) from O(C n/2 <inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">n</inf> ), where k # <n. A case study on learning a standard BN with 50 nodes is conducted. The results demonstrate the superiority of the LOL algorithm, with respect to the Bayesian information criterion (BIC) score criterion, over the hill-climbing, max-min hill-climbing, PC, and three-phrase dependency analysis algorithms.

Learning a Bayesian network with multiple latent variables for implicit relation representation

Efficient Parameter Learning of Bayesian Network with Latent Variables from High-Dimensional Data

Bayesian Network Parameter Learning Using Constraint-Based Data Extension Method

Bayesian Approach to Learn Bayesian Networks Using Data and Constraints.

Structure Learning of Bayesian Network with Latent Variables by Weight-Induced Refinement.

Dynamic Embeddings for Efficient Parameter Learning of Bayesian Network with Multiple Latent Variables

Learning Bayesian Networks by Constrained Bayesian Estimation

Modeling User Preference From Rating Data Based On The Bayesian Network With A Latent Variable

A Novel BN Learning Algorithm Based on Block Learning Strategy

Semantically-linked Bayesian Network: a Framework for Probabilistic Inference over Multiple Bayesian Networks

A Parallel and Incremental Approach for Data-Intensive Learning of Bayesian Networks

Modeling Multi-Dimensional User Preference Based on the Latent Variable Model

Learning Tractable NAT-modeled Bayesian Networks

Finding optimal Bayesian networks by a layered learning method

An Efficient Approach for Parameters Learning of Bayesian Network with Multiple Latent Variables Using Neural Networks and P-EM

A parallel and constraint induced approach to modeling user preference from rating data

Bayesian Network Approach to Multinomial Parameter Learning Using Data and Expert Judgments.

Representing and Inferring Causalities among Classes of Multidimensional Data

Exploiting the Implicit Independence Assumption for Learning Directed Graphical Models.

A Bayesian Network-Based Approach for Incremental Learning of Uncertain Knowledge

Bayesian Network Structure Learning: A Review