Abstract:This paper attempts to argue that most adaptive systems, such as evolutionary or learning systems, have inherently multiple objectives to deal with. Very often, there is no single solution that can optimize all the objectives. In this case, the concept of Pareto optimality is key to analyzing these systems.To support this argument, we first present an example that considers the robustness and evolvability trade-off in a redundant genetic representation for simulated evolution. It is well known that robustness is critical for biological evolution, since without a sufficient degree of mutational robustness, it is impossible for evolution to create new functionalities. On the other hand, the genetic representation should also provide the chance to find new phenotypes, i.e., the ability to innovate. This example shows quantitatively that a trade-off between robustness and innovation does exist in the studied redundant representation.Interesting results will also be given to show that new insights into learning problems can be gained when the concept of Pareto optimality is applied to machine learning. In the first example, a Pareto-based multi-objective approach is employed to alleviate catastrophic forgetting in neural network learning. We show that learning new information and memorizing learned knowledge are two conflicting objectives, and a major part of both information can be memorized when the multi-objective learning approach is adopted. In the second example, we demonstrate that a Pareto-based approach can address neural network regularization more elegantly. By analyzing the Pareto-optimal solutions, it is possible to identifying interesting solutions on the Pareto front.

Exploiting Population Information in Evolutionary Learning

How to Make Best Use of Evolutionary Learning

Making Use of Population Information in Evolutionary Artificial Neural Networks

Evolutionary Learning: Advances in Theories and Algorithms

An Adaptive Real Coded Population-Based Incremental Learning Algorithm for Design Optimizations in Continuous Space

An Improved Population-Based Incremental Learning Method For Inverse Problems

Pareto Analysis of Evolutionary and Learning Systems

Special Issue on Evolutionary Learning and Optimisation

Getting Most Out Of Evolutionary Approaches

Experimental Study on Population-Based Incremental Learning Algorithms for Dynamic Optimization Problems

Evolutionary Dynamics on Any Population Structure

Information-Geometric Optimization with Natural Selection

Learning, evolution and population dynamics

Chainlike Multi-Population Multi-Agent Evolutionary Algorithm

Stochastic Population Update Can Provably Be Helpful in Multi-Objective Evolutionary Algorithms

A New Learning Based Dynamic Multi-Objective Optimisation Evolutionary Algorithm

Evolution with Opponent-Learning Awareness

Recent New Development in Evolutionary Programming

Dual Population-Based Incremental Learning for Problem Optimization in Dynamic Environments

An adaptive multi-population differential evolution algorithm for continuous multi-objective optimization

Evolutionary Dynamics of Population Games With an Aspiration-Based Learning Rule