Abstract:Since estimation of distribution algorithms (EDAs) were proposed, many attempts have been made to improve EDAs' performance in the context of global optimization. So far, the studies or applications of multivariate probabilistic model-based EDAs in continuous domain are still mostly restricted to low-dimensional problems. Traditional EDAs have difficulties in solving higher dimensional problems because of the curse of dimensionality and rapidly increasing computational costs. However, scaling up continuous EDAs for large-scale optimization is still necessary, which is supported by the distinctive feature of EDAs: because a probabilistic model is explicitly estimated, from the learned model one can discover useful properties of the problem. Besides obtaining a good solution, understanding of the problem structure can be of great benefit, especially for black box optimization. We propose a novel EDA framework with model complexity control (EDA-MCC) to scale up continuous EDAs. By employing weakly dependent variable identification and subspace modeling, EDA-MCC shows significantly better performance than traditional EDAs on high-dimensional problems. Moreover, the computational cost and the requirement of large population sizes can be reduced in EDA-MCC. In addition to being able to find a good solution, EDA-MCC can also provide useful problem structure characterizations. EDA-MCC is the first successful instance of multivariate model-based EDAs that can be effectively applied to a general class of up to 500-D problems. It also outperforms some newly developed algorithms designed specifically for large-scale optimization. In order to understand the strengths and weaknesses of EDA-MCC, we have carried out extensive computational studies. Our results have revealed when EDA-MCC is likely to outperform others and on what kind of benchmark functions.

Decentralized Estimation of Distribution Algorithms for Large Scale Networked Systems

A Decentralized Continuous Estimation Of Distribution Algorithm For Networked Systems

Decentralized Differential Evolutionary Algorithm for Large-Scale Networked Systems.

A Survey on Estimation of Distribution Algorithms

Estimation Network Design framework for efficient distributed optimization

Estimation of Distribution Algorithm with Scatter Search for Dynamic Optimisation Problems

A Hybrid Optimization Algorithm Based on Chaotic Differential Evolution and Estimation of Distribution

Research and New Development of Application of the Estimation of Distribution Algorithms

An Estimation of Distribution Algorithm Based on Nonparametric Density Estimation

Distributed estimation over complex networks

A Modified Estimation of Distribution Algorithm for Numeric Optimization

Distributed Stochastic Algorithm for Global Optimization in Networked System

An Estimation of Distribution Algorithm Guided by Mean Shift.

An Estimation Of Distribution Algorithm For Large-Scale Optimization With Cooperative Co-Evolution And Local Search

Scaling Up Estimation of Distribution Algorithms for Continuous Optimization

Estimation of distribution algorithms using Gaussian Bayesian networks to solve industrial optimization problems constrained by environment variables

A layered learning estimation of distribution algorithm

Decentralized Optimization Algorithm of Networked Systems

Hybrid Estimation of Distribution Algorithm for Global Optimization

Estimation of Distribution Algorithm with Path Relinking for the Blocking Flow-Shop Scheduling Problem

Distributed estimation of reorganized call algorithms based on integral number coding