Abstract:Complex system design problems, such as those involved in aerospace engineering, require the use of numerically costly simulation codes in order to predict the performance of the system to be designed. In this context, these codes are often embedded into an optimization process to provide the best design while satisfying the design constraints. Recently, new approaches, called Quality-Diversity, have been proposed in order to enhance the exploration of the design space and to provide a set of optimal diversified solutions with respect to some feature functions. These functions are interesting to assess trade-offs. Furthermore, complex design problems often involve mixed continuous, discrete, and categorical design variables allowing to take into account technological choices in the optimization problem. Existing Bayesian Quality-Diversity approaches suited for intensive high-fidelity simulations are not adapted to mixed variables constrained optimization problems. In order to overcome these limitations, a new Quality-Diversity methodology based on mixed variables Bayesian optimization strategy is proposed in the context of limited simulation budget. Using adapted covariance models and dedicated enrichment strategy for the Gaussian processes in Bayesian optimization, this approach allows to reduce the computational cost up to two orders of magnitude, with respect to classical Quality-Diversity approaches while dealing with discrete choices and the presence of constraints. The performance of the proposed method is assessed on a benchmark of analytical problems as well as on two aerospace system design problems highlighting its efficiency in terms of speed of convergence. The proposed approach provides valuable trade-offs for decision-markers for complex system design.

Triangulation candidates for Bayesian optimization

Voronoi Candidates for Bayesian Optimization

Simulation Based Bayesian Optimization

High-dimensional Bayesian optimization using low-dimensional feature spaces

Bayesian Optimization with High-Dimensional Outputs

Process Quality Control Through Bayesian Optimization with Adaptive Local Convergence

Bayesian optimization of variable-size design space problems

sBF-BO-2CoGP: A Sequential Bi-Fidelity Constrained Bayesian Optimization for Design Applications

A comparison of mixed-variables Bayesian optimization approaches

Bayesian Optimization for Non-Convex Two-Stage Stochastic Optimization Problems

Combinatorial Bayesian Optimization with Random Mapping Functions to Convex Polytopes

Bayesian Quality-Diversity approaches for constrained optimization problems with mixed continuous, discrete and categorical variables

Stratified Bayesian Optimization

Optimizing Posterior Samples for Bayesian Optimization via Rootfinding

A Bayesian Optimization Framework for Finding Local Optima in Expensive Multi-Modal Functions

Hybrid Parameter Search and Dynamic Model Selection for Mixed-Variable Bayesian Optimization

A Bayesian Optimization Framework for Finding Local Optima in Expensive Multimodal Functions

A survey and benchmark of high-dimensional Bayesian optimization of discrete sequences

Parameter Optimization using high-dimensional Bayesian Optimization

High-dimensional Bayesian Optimization with Group Testing