Abstract:The Bayesian network provides a useful way to deal with uncertain information, which helps researchers to better understand the human cognitive process. The foundation of the Bayesian network focuses on identifying the qualitative relations between variables, which is also called structure learning. Local search in the ordering space is an effective method for learning the structure of large-scale Bayesian networks. However, the existing algorithms tend to the local optimum and stop searching for superior solutions. To tackle the problem, random perturbations are applied to the local optimum without specific strategies, resulting in many meaningless restarts that sacrifice much time but still fail to improve the results. As an extension of the local search, simulated annealing stochastically searches the solution spaces and selects relatively poor solutions with a certain probability. This paper proposes a method based on simulated annealing to learn Bayesian network structure in the ordering space, which expands the search scope by probabilistically accepting poorer solutions. Moreover, we improve simulated annealing by adding a memory module and modifying the termination condition. The memory module records the optimal solution before accepting a worse solution, which avoids losing the possible global optimal solution. The new termination condition is related to the quality of the search results, which reduces many redundant searches. Besides, we design a new restart strategy based on ensemble learning. When the search traps in the local optimum, a new ordering is obtained to restart the search by perturbing the current ordering with constraints. The constraints are generated by the results of ensemble learning on multiple structures, which help the algorithm approach the global optimum solution. Experimental results show that our proposed methods improve the accuracy and efficiency in learning the optimal structure over the benchmarks compared to the state-of-the-art algorithms.

Local Search for Learning Algorithm in Adaptive Fuzzy Inference System

Fuzzy Neural Network Based on Hybrid Learning Algorithm and Its Application to Soft Sensor

Model inference of a dynamic system by fuzzy learning of geometric structures

Nonlinear System Modeling by Competitive Learning and Adaptive Fuzzy Inference System.

Fuzzy Logic Navigation of Mobile Robot with On-line Self-learning

Local Bayesian Network Structure Learning for High-Dimensional Data

New global learning algorithm for fuzzy neural networks based on modified quasi-newton method and genetic searching techniques

The Study and Design of Adaptive Learning System Based on Fuzzy Set Theory

Hybrid FCM Learning Algorithm Based on Particle Swarm Optimization and Gradient Descent Algorithm

The Improved Ordering-Based Search Method Incorporating with Ensemble Learning

A Novel Parameter Learning Algorithm for a Self-constructing Fuzzy Neural Network Design

Using local learning with fuzzy transform: application to short term forecasting problems

An Adaptive Network Based Fuzzy Inference System Based on UKF

Batch type local search-based adaptive neuro-fuzzy inference system (ANFIS) with self-feedbacks for time-series prediction

Learning of fuzzy rules and its application to nonlinear system modeling

ANFIS: adaptive-network-based fuzzy inference system

Bayesian Inference Based Learning Automaton Scheme in Fuzzy Environments

A New Evolving Fuzzy Inference System Based on Genetic Algorithm

Fuzzy cognitive map learning based on improved nonlinear Hebbian rule

An Adaptive Traffic Flow Prediction Mechanism Based on Locally Weighted Learning

Modeling and Simulation Applying Adaptive Neural-Fuzzy Inference System(ANFIS)