Estimation of Distribution Algorithms with Matrix Transpose in Bayesian Learning

Dae-Won Kim,Song Ko,Bo-Yeong Kang

2024-07-11

Abstract:Estimation of distribution algorithms (EDAs) constitute a new branch of evolutionary optimization algorithms, providing effective and efficient optimization performance in a variety of research areas. Recent studies have proposed new EDAs that employ mutation operators in standard EDAs to increase the population diversity. We present a new mutation operator, a matrix transpose, specifically designed for Bayesian structure learning, and we evaluate its performance in Bayesian structure learning. The results indicate that EDAs with transpose mutation give markedly better performance than conventional EDAs.

Neural and Evolutionary Computing,Machine Learning

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: How to improve the performance of Estimation of Distribution Algorithms (EDAs) in Bayesian network structure learning by introducing a new mutation operator (matrix transpose).

### Problem Background:
Bayesian network structure learning is an NP - hard optimization problem. As the number of variables increases, the number of possible network structures grows exponentially. Although traditional EDAs perform well when dealing with such problems, they still have certain limitations. In particular, traditional mutation operators (such as bit - mutation) may generate illegal Bayesian network structures (i.e., networks containing loops), thus affecting the effectiveness and efficiency of the algorithm.

### Research Objectives:
1. **Introduce a new mutation operator**: The paper proposes a new mutation operator - matrix transpose, which is specifically used for Bayesian network structure learning.
2. **Evaluate the performance of the new method**: Through experimental evaluation, compare the performance of standard EDAs, EDAs with bit - mutation (EDAs + B), and EDAs with matrix - transpose mutation (EDAs + T) on two datasets (Diabetes and Asia).
3. **Determine the optimal algorithm**: Find out which mutation method can significantly improve the performance of EDAs in Bayesian network structure learning.

### Key Innovation Points:
- **Matrix - transpose mutation operator**: This operator enhances the diversity of the population and increases the possibility of inferring the correct arc direction by reversing the arc directions between nodes in the candidate solution. Different from traditional bit - mutation, matrix - transpose mutation is a closed operation and will not generate illegal network structures containing loops.
- **Probability matrix representation**: Use an n×n probability matrix P to represent the Bayesian network, where P(i, j) represents the probability of an arc existing from node i to node j. In this way, the conditional dependence relationships between nodes can be captured and utilized more intuitively.

### Experimental Results:
The experimental results show that EDAs with matrix - transpose mutation (EDAs + T) perform significantly better than standard EDAs and EDAs with bit - mutation (EDAs + B) on both datasets. In particular, in the PBIL + T algorithm, when the mutation rate is 0.1, its accuracy reaches 79.9%, which is much higher than other versions of the algorithm.

In conclusion, this paper aims to improve the performance of EDAs in Bayesian network structure learning by introducing the matrix - transpose mutation operator, thus providing a new and effective method for solving this complex optimization problem.