Abstract:It is unpractical to learn the optimal structure of a big Bayesian network (BN) by exhausting the feasible structures, since the number of feasible structures is super exponential on the number of nodes. This paper proposes an approach to layer nodes of a BN by using the conditional independence testing. The parents of a node layer only belong to the layer, or layers who have priority over the layer. When a set of nodes has been layered, the number of feasible structures over the nodes can be remarkably reduced, which makes it possible to learn optimal BN structures for bigger sizes of nodes by accurate algorithms. Integrating the dynamic programming (DP) algorithm with the layering approach, we propose a hybrid algorithm — layered optimal learning (LOL) to learn BN structures. Benefitted by the layering approach, the complexity of the DP algorithm reduces to O(ρ2 n−1 ) from O(n2 n−1 ), where ρ < n. Meanwhile, the memory requirements for storing intermediate results are limited to O(C k#/2 <inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">k#</inf> ) from O(C n/2 <inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">n</inf> ), where k # <n. A case study on learning a standard BN with 50 nodes is conducted. The results demonstrate the superiority of the LOL algorithm, with respect to the Bayesian information criterion (BIC) score criterion, over the hill-climbing, max-min hill-climbing, PC, and three-phrase dependency analysis algorithms.

Incremental learning Bayesian network structures efficiently

Hybrid Incremental Learning Algorithms for Bayesian Network Structures

Financial Data Modeling using a Hybrid Bayesian Network Structured Learning Algorithm

A Bayesian Network Structure Learning Algorithm Based on Probabilistic Incremental Analysis and Constraint

An Improved Incremental Structure Learning Algorithm for Bayesian Networks

An Incremental Bayesian Network Structure Learning Algorithm Based on Local Updating Strategy

Incremental Learning Bayesian Networks for Financial Data Modeling

An incremental structure learning approach for Bayesian Network

Improved Population-Based Incremental Learning of Bayesian Networks with partly known structure and parallel computing

Bayesian Network Structure Learning Algorithm Based on Score Increment and Reduction

A Bayesian Network-Based Approach for Incremental Learning of Uncertain Knowledge

Hybrid Optimization Algorithm for Bayesian Network Structure Learning

An Incremental Approach to Learning Bayesian Networks Containing Hidden Variables

A Comparatively Research in Incremental Learning of Bayesian Networks

Finding optimal Bayesian networks by a layered learning method

Bayesian network structures learning based on approach using incoporate priors method

An Efficient Procedure for Computing Bayesian Network Structure Learning

Bidirectional Heuristic Search for Bayesian Network Structure with Ancestral Partition

An Incremental Approach for Sparse Bayesian Network Structure Learning

An Efficient Bayesian Network Structure Learning Algorithm Using the Strategy of Two-Stage Searches.