Abstract:It is unpractical to learn the optimal structure of a big Bayesian network (BN) by exhausting the feasible structures, since the number of feasible structures is super exponential on the number of nodes. This paper proposes an approach to layer nodes of a BN by using the conditional independence testing. The parents of a node layer only belong to the layer, or layers who have priority over the layer. When a set of nodes has been layered, the number of feasible structures over the nodes can be remarkably reduced, which makes it possible to learn optimal BN structures for bigger sizes of nodes by accurate algorithms. Integrating the dynamic programming (DP) algorithm with the layering approach, we propose a hybrid algorithm — layered optimal learning (LOL) to learn BN structures. Benefitted by the layering approach, the complexity of the DP algorithm reduces to O(ρ2 n−1 ) from O(n2 n−1 ), where ρ < n. Meanwhile, the memory requirements for storing intermediate results are limited to O(C k#/2 <inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">k#</inf> ) from O(C n/2 <inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">n</inf> ), where k # <n. A case study on learning a standard BN with 50 nodes is conducted. The results demonstrate the superiority of the LOL algorithm, with respect to the Bayesian information criterion (BIC) score criterion, over the hill-climbing, max-min hill-climbing, PC, and three-phrase dependency analysis algorithms.

Incorporating Path Constraints into Bayesian Network under the Sparse Parent Graph

Learning Bayesian Networks Using A* Search with Ancestral Constraints

Bayesian Approach to Learn Bayesian Networks Using Data and Constraints.

Causal Constraint Pruning for Exact Learning of Bayesian Network Structure

Bayesian Network Structure Learning by Dynamic Programming Algorithm Based on Node Block Sequence Constraints

Dynamic Programming BN Structure Learning Algorithm Integrating Double Constraints under Small Sample Condition

Bayesian Network Parameter Learning Using Constraint-Based Data Extension Method

Learning Bayesian Networks by Constrained Bayesian Estimation

Bayesian network parameter learning using fuzzy constraints.

Bayesian network structures learning based on approach using incoporate priors method

Bidirectional Heuristic Search for Bayesian Network Structure with Ancestral Partition

Static bayesian network parameter learning using constraints

Learning the structure of Bayesian networks with ancestral and/or heuristic partition

Learning Bayesian networks based on order graph with ancestral constraints

Improved Parameter Uniform Priors in Bayesian Network Structure Learning

Finding optimal Bayesian networks by a layered learning method

Bayesian Network Revision with Probabilistic Constraints

Bayesian Network Parameter Learning with Constraint Balance

Bayesian Network Structure Learning Algorithm Based on Score Increment and Reduction

Bayesian network learning with cutting planes

Finding Community Structure in Bayesian Networks by Heuristic K-Standard Deviation Method