Bayesian Optimisation for Quality Diversity Search With Coupled Descriptor Functions

Paul Kent,Adam Gaier,Jean-Baptiste Mouret,Juergen Branke
DOI: https://doi.org/10.1109/tevc.2024.3376733
IF: 16.497
2024-01-01
IEEE Transactions on Evolutionary Computation
Abstract:Quality Diversity (QD) algorithms such as MAP-Elites are a class of optimisation techniques that attempt to find many high performing points that all behave differently according to a user-defined behavioural metric. In this paper we propose the Bayesian Optimisation of Elites (BOP-Elites) algorithm. Designed for problems with expensive black-box objective and behaviour functions, it is able to return a QD solution-set after a relatively small number of samples. BOP-Elites models both objective and behavioural descriptors with Gaussian Process surrogate models and uses Bayesian Optimisation strategies for choosing points to evaluate in order to solve the quality-diversity problem. In addition, BOP-Elites produces high quality surrogate models which can be used after convergence to predict solutions with any behaviour in a continuous range. An empirical comparison shows that BOP-Elites significantly outperforms other state-of-the-art algorithms without the need for problem-specific parameter tuning.
computer science, artificial intelligence, theory & methods
What problem does this paper attempt to address?