Abstract:Bayesian network is a popular approach to uncertainty knowledge representation and reasoning. Structure learning is the first step to learn a Bayesian network. Score-based methods are one of the most popular ways of learning the structure. In most cases, the score of Bayesian network is defined as adding the log-likelihood score and complexity score by using the penalty function. If the penalty function is set unreasonably, it may hurt the performance of structure search. Thus, Bayesian network structure learning is essentially a bi-objective optimization problem. However, the existing bi-objective structure learning algorithms can only be applied to small-scale networks. To this end, this paper proposes a bi-objective evolutionary Bayesian network structure learning algorithm via skeleton constraint (BBS) for the medium-scale networks. To boost the performance of searching, BBS introduces the random order prior (ROP) initial operator. ROP generates a skeleton to constrain the searching space, which is the key to expanding the scale of structure learning problems. Then, the acyclic structures are guaranteed by adding the orders of variables in the initial skeleton. After that, BBS designs the Pareto rank based crossover and skeleton guided mutation operators. The operators operate on the skeleton obtained in ROP to make the search more targeted. Finally, BBS provides a strategy to choose the final solution. The experimental results show that BBS can always find the structure which is closer to the ground truth compared with the single-objective structure learning methods. Furthermore, compared with the existing bi-objective structure learning methods, BBS is scalable and can be applied to medium-scale Bayesian network datasets. On the educational problem of discovering the influencing factors of students’ academic performance, BBS provides higher quality solutions and is featured with the flexibility of solution selection compared with the widely-used Bayesian network structure learning methods.

Bayesian networks structure learning based on improved BIC scoring

Learning Cluster Causal Diagrams: an Information-Theoretic Approach

Locally Weighted Learning: How and when Does It Work in Bayesian Networks?

An Improved Particle Swarm Optimization Algorithm for Bayesian Network Structure Learning via Local Information Constraint

Research on Bayesian Network Structure Score Function

Improved Population-Based Incremental Learning of Bayesian Networks with partly known structure and parallel computing

Learning the Structure of Bayesian Networks: A Quantitative Assessment of the Effect of Different Algorithmic Schemes

A survey of Bayesian Network structure learning

A Bayesian Network Structure Learning Algorithm Based on Probabilistic Incremental Analysis and Constraint

An efficient Bayesian network structure learning algorithm based on structural information

RBNets: A Reinforcement Learning Approach for Learning Bayesian Network Structure

Incorporating expert knowledge when learning Bayesian network structure: A medical case study

Learning Bayesian Network Structures Based on Mutual Information

Learning Bayesian Network Structure from Large-Scale Datasets

Research of Learning Bayesian Networks Structure

Learning in a hybrid Bayesian network structure for causal analysis

Bi-Objective Evolutionary Bayesian Network Structure Learning Via Skeleton Constraint

Improved Bayesian Network Structure Learning With Node Ordering Via K2 Algorithm

Improved K2 algorithm for Bayesian network structure learning

Bi-Objective Search Method for Bayesian Network Structure Learning

Additive Dynamic Bayesian Networks for Enhanced Feature Learning in Soft Sensor Modeling