Abstract:The rapid development of parallel and distributed computing paradigms has brought about great revolution in computing. Thanks to the intrinsic parallelism of evolutionary computation (EC), it is natural to implement EC on parallel and distributed computing systems. On the one hand, the computing power provided by parallel computing systems can significantly improve the efficiency and scalability of EC. On the other hand, data are collected and processed in a distributed manner, which brings a novel development direction and new challenges to EC. In this paper, we intend to give a systematic review on distributed EC (DEC). First, a new taxonomy for DEC is proposed from top design mechanism to bottom implementation mechanism. Based on this taxonomy, existing studies on DEC are reviewed in terms of purpose, parallel structure of the algorithm, parallel model for implementation, and the implementation environment. Second, we clarify two major purposes of DEC, i.e., improving efficiency through parallel processing for centralized optimization and cooperating distributed individuals/sub-populations with partial information to perform distributed optimization. Third, noting that the latter purpose of DEC is an emerging and attractive trend for EC with the booming of spatially distributed paradigms, this paper gives a systematic definition of the distributed optimization and classifies it into dimension distributed-, data distributed-, and objective distributed-optimization problems. Formal formulations for these problems are provided and various DEC studies on these problems are reviewed. We also discuss challenges and potential research directions, aiming to enlighten the design of DEC and pave the way for future developments.

A Distributed Cooperative Co-Evolutionary Algorithm Based on Ring Network for Distributed Large-Scale Optimization.

Distributed Cooperative Co-Evolution with Adaptive Computing Resource Allocation for Large Scale Optimization

A Scalable Parallel Coevolutionary Algorithm with Overlapping Cooperation for Large-Scale Network-Based Combinatorial Optimization

A Distributed Cooperative Co-evolutionary CMA Evolution Strategy for Global Optimization of Large-Scale Overlapping Problems.

An Empirical Study of Cooperative Frequency in Distributed Cooperative Co-Evolution

Overlapped Cooperative Co-evolution for Large Scale Optimization

A Distributed Parallel Cooperative Coevolutionary Multiobjective Evolutionary Algorithm for Large-Scale Optimization.

An Adaptive Cooperative Frequency Strategy in Distributed Cooperative Co-evolution

A Multi-Optimizer Cooperative Coevolution Method For Large Scale Optimization

Edge–Cloud Co-Evolutionary Algorithms for Distributed Data-Driven Optimization Problems

Distributed Dynamic optimization Scheme based on Cooperative Differential Games

ECdo: an Edge Computing Distributed Data-Driven Evolutionary Optimization Platform

A Multiagent Co-Evolutionary Algorithm with Penalty-Based Objective for Network-Based Distributed Optimization

Competitive-Cooperative Coevolution for Large Scale Optimization with Computation Resource Allocation Pool

A Collaborative Solving Algorithm for Dynamic Distributed Constraint Optimization Problem

Efficient Resource Allocation in Cooperative Co-Evolution for Large-Scale Global Optimization

A Survey on Distributed Evolutionary Computation

Dynamic Cooperative Coevolution for Large Scale Optimization

A Distributed Co-Evolutionary Optimization Method with Motif for Large-Scale IoT Robustness

Cooperative Coevolution for Non-Separable Large-Scale Black-Box Optimization: Convergence Analyses and Distributed Accelerations

Cooperative Co-Evolution with Correlation Identification Grouping for Large Scale Function Optimization