Abstract:In recent years, there has been a great interest in learning Bayesian networks from data. A difficulty of learning Bayesian networks is how to discover hidden variables. Hidden variables are not observed in data set, yet interact with several of the observed variables. Introducing hidden variables is helpful for learning a concise structure that is crucial both for avoiding overfitting and for efficient inference in the learned model. In this paper, based on Genetic algorithm a learning algorithm that can detect hidden variables is proposed. Fitness function is presented to evaluate network structure that may include hidden variables. To make computation of fitness feasible, it is advisable to convert incomplete data to complete data. In this paper, this conversion is carried out by current best model of evolution procedure. Variables of individuals pending evaluation and variables of current best individual may be different. To make the latter same as the former, expectation, projection, expansion operation of data set are given. Fitness function based in Minimum description length is designed on this transformed data set. Length-variable encoding is given, where a gene of the individual corresponds to parents of a variable. Besides, genetic operators that evolve structure are designed. Selection operator is selected as rank proportional to avoid premature convergence. Crossover operator is metabolic uniformity crossover, which give chance for good local structures of different individuals to recombine. Five mutation operators are introduced, adding a parent for a variable, deleting a parent of a variable, reversing arc, adding new variable according to structure complexity-local structures overlap much tending to suggest the presence of a hidden variable, deleting introduced variable. Experimental results show that this algorithm can effectively detect variables so that the learned structure takes on good performance.

Learning Bayesian Networks with Hidden Variables Using the Combination of EM and Evolutionary Algorithms

Learning Bayesian Networks with the Combination of Evolutionary Algorithm and Emi Method

A Novel Hybrid Evolutionary Algorithm for Learning Bayesian Networks from Incomplete Data

Learning bayesian networks using domain knowledge: An empirical study

Incremental Learning Of Bayesian Networks With Hidden Variables

A New Evolutionary Computation Based Approach for Learning Bayesian Network

Learning Bayesian Networks From Data: An Efficient Approach Based On Extended Evolutionary Programming

Learning Bayesian Networks Structures From Incomplete Data Based On Extending Evolutionary Programming

An Incremental Approach to Learning Bayesian Networks Containing Hidden Variables

A New Method Of Learning Bayesian Networks Structures From Incomplete Data

Research On Learning Bayesian Network Structure With Hidden Variables Based On Genetic Algorithms

Learning Bayesian Networks Using Evolutionary Algorithm And A Variant Of Mdl Score

Learning Bayesian Networks Structures Based on Extending Evolutionary Programming

Learning Bayesian Networks from Incomplete Data Based on EMI Method

Research on Modeling with Dynamic Bayesian Networks

Learning Bayesian Networks Based on a Mutual Information Scoring Function and EMI Method

DBN Learning Algorithm Based on Evolutionary MCMC

Learning Bayesian Networks Using a Parallel EM Approach

Learning The Bayesian Networks Structure Based On Ant Colony Optimization And Differential Evolution

Learning Dynamic Bayesian Network with Immune Evolutionary Algorithm

Learning Bayesian Networks With Combination Of Mrmr Criterion And Emi Method