Abstract:Bayesian network is a popular approach to uncertainty knowledge representation and reasoning. Structure learning is the first step to learn a Bayesian network. Score-based methods are one of the most popular ways of learning the structure. In most cases, the score of Bayesian network is defined as adding the log-likelihood score and complexity score by using the penalty function. If the penalty function is set unreasonably, it may hurt the performance of structure search. Thus, Bayesian network structure learning is essentially a bi-objective optimization problem. However, the existing bi-objective structure learning algorithms can only be applied to small-scale networks. To this end, this paper proposes a bi-objective evolutionary Bayesian network structure learning algorithm via skeleton constraint (BBS) for the medium-scale networks. To boost the performance of searching, BBS introduces the random order prior (ROP) initial operator. ROP generates a skeleton to constrain the searching space, which is the key to expanding the scale of structure learning problems. Then, the acyclic structures are guaranteed by adding the orders of variables in the initial skeleton. After that, BBS designs the Pareto rank based crossover and skeleton guided mutation operators. The operators operate on the skeleton obtained in ROP to make the search more targeted. Finally, BBS provides a strategy to choose the final solution. The experimental results show that BBS can always find the structure which is closer to the ground truth compared with the single-objective structure learning methods. Furthermore, compared with the existing bi-objective structure learning methods, BBS is scalable and can be applied to medium-scale Bayesian network datasets. On the educational problem of discovering the influencing factors of students’ academic performance, BBS provides higher quality solutions and is featured with the flexibility of solution selection compared with the widely-used Bayesian network structure learning methods.

An Exploration of Structure Learning in Bayesian Networks

Structure Learning of Bayesian Networks by Finding the Optimal Ordering

A survey of Bayesian Network structure learning

Bayesian Network Structure Learning Algorithm Based on Score Increment and Reduction

An efficient Bayesian network structure learning algorithm based on structural information

Local Structure Discovery in Bayesian Networks

Learning the Structure of Bayesian Networks: A Quantitative Assessment of the Effect of Different Algorithmic Schemes

Biased Random-Key Genetic Algorithm for Structure Learning

An Improved Evolutionary Approach-Based Hybrid Algorithm for Bayesian Network Structure Learning in Dynamic Constrained Search Space

Bi-Objective Search Method for Bayesian Network Structure Learning

An algorithm for cooperative learning of bayesian network structure from data

Learning Bayesian Networks with Local Structure

Learning Bayesian Networks in the Space of Structures by a Hybrid Optimization Algorithm.

Determining the Direction of the Local Search in Topological Ordering Space for Bayesian Network Structure Learning

Bidirectional Heuristic Search for Bayesian Network Structure with Ancestral Partition

A Hybrid Bayesian Network Structure Learning Algorithm in Equivalence Class Space

Learning Equivalence Classes of Bayesian Networks Structures

Bi-Objective Evolutionary Bayesian Network Structure Learning Via Skeleton Constraint

Learning The Bayesian Networks Structure Based On Ant Colony Optimization And Differential Evolution

Bayesian Optimization Algorithm for learning structure of dynamic bayesian networks from incomplete data

Research On Learning Bayesian Network Structure With Hidden Variables Based On Genetic Algorithms