Abstract:Bayesian network is a popular approach to uncertainty knowledge representation and reasoning. Structure learning is the first step to learn a Bayesian network. Score-based methods are one of the most popular ways of learning the structure. In most cases, the score of Bayesian network is defined as adding the log-likelihood score and complexity score by using the penalty function. If the penalty function is set unreasonably, it may hurt the performance of structure search. Thus, Bayesian network structure learning is essentially a bi-objective optimization problem. However, the existing bi-objective structure learning algorithms can only be applied to small-scale networks. To this end, this paper proposes a bi-objective evolutionary Bayesian network structure learning algorithm via skeleton constraint (BBS) for the medium-scale networks. To boost the performance of searching, BBS introduces the random order prior (ROP) initial operator. ROP generates a skeleton to constrain the searching space, which is the key to expanding the scale of structure learning problems. Then, the acyclic structures are guaranteed by adding the orders of variables in the initial skeleton. After that, BBS designs the Pareto rank based crossover and skeleton guided mutation operators. The operators operate on the skeleton obtained in ROP to make the search more targeted. Finally, BBS provides a strategy to choose the final solution. The experimental results show that BBS can always find the structure which is closer to the ground truth compared with the single-objective structure learning methods. Furthermore, compared with the existing bi-objective structure learning methods, BBS is scalable and can be applied to medium-scale Bayesian network datasets. On the educational problem of discovering the influencing factors of students’ academic performance, BBS provides higher quality solutions and is featured with the flexibility of solution selection compared with the widely-used Bayesian network structure learning methods.

Improved Parameter Uniform Priors in Bayesian Network Structure Learning

Study on metric decomposition for DBN structure learning

Bayesian Network Parameter Learning Using Constraint-Based Data Extension Method

Bayesian network structures learning based on approach using incoporate priors method

Learning Bayesian Network Parameters from Small Data Set: A Spatially Maximum a Posteriori Method.

Bayesian Approach to Learn Bayesian Networks Using Data and Constraints.

Static bayesian network parameter learning using constraints

Incorporating Path Constraints into Bayesian Network under the Sparse Parent Graph

Bayesian networks structure learning based on improved BIC scoring

Research on Bayesian Network Structure Score Function

Decoupling Sparsity and Smoothness in Dirichlet Belief Networks

Learning Bayesian Networks by Constrained Bayesian Estimation

Bayesian Network Structure Learning Algorithm Based on Score Increment and Reduction

Learning Bayesian Networks Using the Constrained Maximum a Posteriori Probability Method

Learning Bayesian Network Parameters Via Minimax Algorithm

Structure Learning of Bayesian Networks by Finding the Optimal Ordering

Structure Learning for Piecewise Stationary Varying DBN in Model Section

A local scoring-search algorithm for restricted Bayesian networks structure learning

Sparse Bayesian Learning for Network Structure Reconstruction Based on Evolutionary Game Data

Bi-Objective Evolutionary Bayesian Network Structure Learning Via Skeleton Constraint

Efficient Parameter Learning of Bayesian Network with Latent Variables from High-Dimensional Data