Abstract:The Bayesian network provides a useful way to deal with uncertain information, which helps researchers to better understand the human cognitive process. The foundation of the Bayesian network focuses on identifying the qualitative relations between variables, which is also called structure learning. Local search in the ordering space is an effective method for learning the structure of large-scale Bayesian networks. However, the existing algorithms tend to the local optimum and stop searching for superior solutions. To tackle the problem, random perturbations are applied to the local optimum without specific strategies, resulting in many meaningless restarts that sacrifice much time but still fail to improve the results. As an extension of the local search, simulated annealing stochastically searches the solution spaces and selects relatively poor solutions with a certain probability. This paper proposes a method based on simulated annealing to learn Bayesian network structure in the ordering space, which expands the search scope by probabilistically accepting poorer solutions. Moreover, we improve simulated annealing by adding a memory module and modifying the termination condition. The memory module records the optimal solution before accepting a worse solution, which avoids losing the possible global optimal solution. The new termination condition is related to the quality of the search results, which reduces many redundant searches. Besides, we design a new restart strategy based on ensemble learning. When the search traps in the local optimum, a new ordering is obtained to restart the search by perturbing the current ordering with constraints. The constraints are generated by the results of ensemble learning on multiple structures, which help the algorithm approach the global optimum solution. Experimental results show that our proposed methods improve the accuracy and efficiency in learning the optimal structure over the benchmarks compared to the state-of-the-art algorithms.

Bidirectional Heuristic Search to Find the Optimal Bayesian Network Structure

Bidirectional Heuristic Search for Bayesian Network Structure with Ancestral Partition

Structure Learning of Bayesian Networks by Finding the Optimal Ordering

The Improved Ordering-Based Search Method Incorporating with Ensemble Learning

Determining the Direction of the Local Search in Topological Ordering Space for Bayesian Network Structure Learning

A Hybrid Bayesian Network Structure Learning Algorithm in Equivalence Class Space

An Efficient Bayesian Network Structure Learning Algorithm Using the Strategy of Two-Stage Searches.

Learning Bayesian Networks Using A* Search with Ancestral Constraints

Hybrid Optimization Algorithm for Bayesian Network Structure Learning

Improving greedy local search methods by switching the search space

Improved Heuristic Equivalent Search Algorithm Based on Maximal Information Coefficient for Bayesian Network Structure Learning.

Finding Community Structure in Bayesian Networks by Heuristic K-Standard Deviation Method

An Improved Evolutionary Approach-Based Hybrid Algorithm for Bayesian Network Structure Learning in Dynamic Constrained Search Space

Bayesian Network Structure Learning Algorithm Based on Score Increment and Reduction

Bayesian network structures learning based on approach using incoporate priors method

Learning the structure of Bayesian networks with ancestral and/or heuristic partition

MMOS+ Ordering Search Method for Bayesian Network Structure Learning and Its Application

Bayesian Network Structure Learning Based on Restricted Particle Swarm Optimization

An Improved Structure Learning Algorithm of Bayesian Network Based on the Hesitant Fuzzy Information Flow

Bi-Objective Search Method for Bayesian Network Structure Learning

Research of Learning Bayesian Networks Structure