ERGO-II: An Improved Bayesian Optimization Technique for Robust Design with Multiple Objectives, Failed Evaluations and Stochastic Parameters

Jolan Wauters
DOI: https://doi.org/10.1115/1.4064674
2024-02-06
Journal of Mechanical Design
Abstract:Abstract In this work, the Efficient Robust Global Optimization (ERGO) method is revisited with the aim of enhancing and expanding its existing capabilities. The original objective of ERGO was to address the computational challenges associated with optimization-under-uncertainty through the use of Bayesian optimization (BO). ERGO tackles robust optimization problems which are characterized by sensitivity in the objective function due to stochasticity in the design space. It does this by concurrently minimizing the mean and variance of the objective in a multi-objective setting. To handle the computational complexity arising from the uncertainty propagation, ERGO exploits the analytical expression of the surrogate model underlying BO. In this study, ERGO is extended to accommodate multiple objectives, incorporate an improved predictive error estimation approach, investigate the treatment of failed function evaluations, and explore the handling of stochastic parameters next to stochastic design variables. To evaluate the effectiveness of these improvements, the enhanced ERGO scheme is compared with the original method using an analytical test problem with varying dimensionality. Additionally, the novel optimization technique is applied to an aerodynamic design problem to validate its performance.
engineering, mechanical
What problem does this paper attempt to address?
The paper aims to address computational challenges arising from uncertainties in the optimization process, particularly in Robust Design Optimization (RDO). Specifically, the goal of the paper is to improve the existing Efficient Robust Global Optimization (ERGO) method to enhance its ability to handle multiple objectives, failure assessments, and random parameters. The specific issues the paper attempts to address are as follows: 1. **Multi-objective Optimization**: The original ERGO method could only handle two objectives (mean and variance). The new method introduces Hypervolume Expected Improvement to handle more objectives. 2. **Improved Prediction Error Estimation**: The original ERGO method used the First-Order Second Moment (FOSM) method to evaluate prediction variance, which could lead to underestimation in some regions. The new method introduces the Second-Order Second Moment (SOSM) method to better evaluate prediction variance. 3. **Handling Function Evaluation Failures**: The original ERGO method did not consider the possibility of objective function failures. The new method introduces a classifier to predict the feasible region and guide the acquisition function. 4. **Handling Random Parameters**: The original ERGO method could only handle random design variables and could not directly assess the impact of parameter changes on the objectives. The new method extends the capability to handle random parameters. Through these improvements, the paper aims to enhance the performance and efficiency of the ERGO method in Robust Design Optimization.