Abstract:The rapid development of parallel and distributed computing paradigms has brought about great revolution in computing. Thanks to the intrinsic parallelism of evolutionary computation (EC), it is natural to implement EC on parallel and distributed computing systems. On the one hand, the computing power provided by parallel computing systems can significantly improve the efficiency and scalability of EC. On the other hand, data are collected and processed in a distributed manner, which brings a novel development direction and new challenges to EC. In this paper, we intend to give a systematic review on distributed EC (DEC). First, a new taxonomy for DEC is proposed from top design mechanism to bottom implementation mechanism. Based on this taxonomy, existing studies on DEC are reviewed in terms of purpose, parallel structure of the algorithm, parallel model for implementation, and the implementation environment. Second, we clarify two major purposes of DEC, i.e., improving efficiency through parallel processing for centralized optimization and cooperating distributed individuals/sub-populations with partial information to perform distributed optimization. Third, noting that the latter purpose of DEC is an emerging and attractive trend for EC with the booming of spatially distributed paradigms, this paper gives a systematic definition of the distributed optimization and classifies it into dimension distributed-, data distributed-, and objective distributed-optimization problems. Formal formulations for these problems are provided and various DEC studies on these problems are reviewed. We also discuss challenges and potential research directions, aiming to enlighten the design of DEC and pave the way for future developments.

The review of distributed cognition research

Studies and Trend of Psychological Research in Distributed Decision Support System

Using Distributed Cognition Theory to Analyze Collaborative Computer Science Learning

The Bound of Cognition and Mind:A Brief Review of the Modern Studies of Cognitive System

The Distributed Cognition Perspective on Human Interaction

Distributed Cognition as a Theoretical Framework for Information Visualization

Situating distributed cognition

A Literature Review of the Universal and Atomic Elements of Complex Cognition

A Review of Developmental Cognitive Neuroscience

Review on Deep-learning-based Cognitive Computing

A roadmap on learning and reasoning for distributed computing continuum ecosystems

COGNITIVE ARCHITECTURE OF A DISTRIBUTION MANAGEMENT SYSTEM

Distributed Optimization: Advances in Theories, Methods, and Applications

Cognition of Reading from Multidisciplinary Perspective：Review and Relfection

A Literature Review of Distributed Innovation Theory

Emergent Computation of Complex Systems: a Comprehensive Review

Distributed Recommendation Systems: Survey and Research Directions

Distributed cooperative optimization and its applications

A Survey on Distributed Evolutionary Computation

A comprehensive review of planning, modeling, optimization, and control of distributed energy systems

Metacognitive monitoring and control in distributed cognition