Abstract:This talk attempts to argue that almost all adaptive systems have multiple objectives to achieve. Very often, there is no single solution that can optimize all objectives, in which case, the concept of Pareto-optimization plays an important rule. Examples will be given ranging from engineering design, machine learning, to biological systems to show how Pareto-optimality can make a difference in analyzing these systems. The first example we will discuss is the aerodynamic design optimization of turbine blades, where energy efficiency in terms of pressure loss as well as the variation of pressure distribution must be minimized. One additional difficulty in aerodynamic design optimization is that the quality of candidate designs must be assessed by performing computational fluid dynamics analysis, which is very time consuming. To reduce computation time, computational techniques like parallel computation, and machine learning techniques, such as meta-modeling can be employed. Surprisingly interesting results will also be achieved when the concept of Pareto-optimality is applied to machine learning. Two cases will be provided to illustrate this idea. In the first case, we show how Pareto-based approach can address neural network regularization more elegantly, through which deeper insights into the problem can be gained. In the second case, we show that analysis of the Pareto-optimal solutions will help determine the optimal number of clusters in data clustering, which again shown how the Pareto front can disclose additional knowledge about the problem at hand. The final example is concerned with tradeoffs in simulated evolution of genetic representation. It has been argued that robustness is critical for biological evolution, because without certain degree of robustness to mutations, it is impossible for evolution to create new functionalities. Therefore, evolution must find representations that are sufficiently robust yet have the potential to innovate. Examples will be given to show that such tradeoff does exist in evolving both a stationary genotype-phenotype mapping, and also a gene regulatory network described by a random Boolean network.

Pareto-optimality is everywhere: From engineering design, machine learning, to biological systems.

Pareto Analysis of Evolutionary and Learning Systems

Optimization on Pareto sets: On a theory of multi-objective optimization

Evolutionary Optimization of Complex Systems in Uncertain Environments

A Hybrid 2-stage Neural Optimization for Pareto Front Extraction

Overcoming Brittleness in Pareto-Optimal Learning-Augmented Algorithms

An Adaptive Real Coded Population-Based Incremental Learning Algorithm for Design Optimizations in Continuous Space

Trade-off Between Performance and Robustness: an Evolutionary Multiobjective Approach

Generalized Inverse Optimal Control and its Application in Biology

Transforming Design Spaces Using Pareto-Laplace Filters

Neural Networks Designing Neural Networks: Multi-Objective Hyper-Parameter Optimization

Pareto Efficiency in Robust Optimization

Multiple Pareto-optimal solutions of the dissipation-adaptation trade-off

Optimization's Neglected Normative Commitments

Evolutionary Multi-Objective Optimization of Robustness and Innovation in Redundant Genetic Representations

Pareto-Based Multiobjective Machine Learning: an Overview and Case Studies

Comprehensive Pareto Efficiency in Robust Counterpart Optimization

Pareto optimization with small data by learning across common objective spaces

Don't Play Games, Optimize

Pareto-Optimization Framework for Automated Network-on-Chip Design

Random Pareto front surfaces