Abstract:It is unpractical to learn the optimal structure of a big Bayesian network (BN) by exhausting the feasible structures, since the number of feasible structures is super exponential on the number of nodes. This paper proposes an approach to layer nodes of a BN by using the conditional independence testing. The parents of a node layer only belong to the layer, or layers who have priority over the layer. When a set of nodes has been layered, the number of feasible structures over the nodes can be remarkably reduced, which makes it possible to learn optimal BN structures for bigger sizes of nodes by accurate algorithms. Integrating the dynamic programming (DP) algorithm with the layering approach, we propose a hybrid algorithm — layered optimal learning (LOL) to learn BN structures. Benefitted by the layering approach, the complexity of the DP algorithm reduces to O(ρ2 n−1 ) from O(n2 n−1 ), where ρ < n. Meanwhile, the memory requirements for storing intermediate results are limited to O(C k#/2 <inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">k#</inf> ) from O(C n/2 <inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">n</inf> ), where k # <n. A case study on learning a standard BN with 50 nodes is conducted. The results demonstrate the superiority of the LOL algorithm, with respect to the Bayesian information criterion (BIC) score criterion, over the hill-climbing, max-min hill-climbing, PC, and three-phrase dependency analysis algorithms.

Structure Learning Based on Ordering of Sets

Structure Learning of Bayesian Networks by Finding the Optimal Ordering

Structure Learning of Bayesian Networks Based on the LARS-MMPC Ordering Search Method

The Improved Ordering-Based Search Method Incorporating with Ensemble Learning

Determining the Direction of the Local Search in Topological Ordering Space for Bayesian Network Structure Learning

Bayesian Network Structure Learning Algorithm Based on Score Increment and Reduction

Bayesian Network Structure Learning Based on Restricted Particle Swarm Optimization

Bidirectional Heuristic Search for Bayesian Network Structure with Ancestral Partition

Bidirectional Heuristic Search to Find the Optimal Bayesian Network Structure

Finding optimal Bayesian networks by a layered learning method

A Hybrid Bayesian Network Structure Learning Algorithm in Equivalence Class Space

The impact of variable ordering on Bayesian network structure learning

Structure Learning for Piecewise Stationary Varying DBN in Model Section

Bayesian network structures learning based on approach using incoporate priors method

A Multi-Granularity Information-Based Method for Learning High-Dimensional Bayesian Network Structures

Bayesian Network Structure Learning with a New Ensemble Weights and Edge Constraints Setting Mechanism

Learning Bayesian networks from big data with greedy search: computational complexity and efficient implementation

MMOS+ Ordering Search Method for Bayesian Network Structure Learning and Its Application

Learning Bayesian Network Structure from Small Data Set

Learning Equivalence Classes of Bayesian Networks Structures

Learning the structure of Bayesian networks with ancestral and/or heuristic partition