Abstract:Numerical simulations consist of many components that affect the simulation accuracy and the required computational resources. However, finding an optimal combination of components and their parameters under constraints can be a difficult, time-consuming and often manual process. Classical adaptivity does not fully solve the problem, as it comes with significant implementation cost and is difficult to expand to multi-dimensional parameter spaces. Also, many existing data-based optimization approaches treat the optimization problem as a black-box, thus requiring a large amount of data. We present a constrained, model-based Bayesian optimization approach that avoids black-box models by leveraging existing knowledge about the simulation components and properties of the simulation behavior. The main focus of this paper is on the stochastic modeling ansatz for simulation error and run time as optimization objective and constraint, respectively. To account for data covering multiple orders of magnitude, our approach operates on a logarithmic scale. The models use a priori knowledge of the simulation components such as convergence orders and run time estimates. Together with suitable priors for the model parameters, the model is able to make accurate predictions of the simulation behavior. Reliably modeling the simulation behavior yields a fast optimization procedure because it enables the optimizer to quickly indicate promising parameter values. We test our approach experimentally using the multi-scale muscle simulation framework OpenDiHu and show that we successfully optimize the time step widths in a time splitting approach in terms of minimizing the overall error under run time constraints.

Bounds optimization of model response moments: a twin-engine Bayesian active learning method

Collaborative and Adaptive Bayesian Optimization for bounding variances and probabilities under hybrid uncertainties

Bayesian probabilistic propagation of hybrid uncertainties: Estimation of response expectation function, its variable importance and bounds

Constrained Bayesian Optimization with Adaptive Active Learning of Unknown Constraints

Boundary Exploration for Bayesian Optimization With Unknown Physical Constraints

Respecting the limit:Bayesian optimization with a bound on the optimal value

Bayesian Optimization through Gaussian Cox Process Models for Spatio-temporal Data

Interval uncertainty propagation by a parallel Bayesian global optimization method

Uncertainty Quantification for Bayesian Optimization

Simulation Based Bayesian Optimization

Knowledge-based modeling of simulation behavior for Bayesian optimization

Online Calibrated and Conformal Prediction Improves Bayesian Optimization

Approximation-Aware Bayesian Optimization

Adaptive Expansion Bayesian Optimization for Unbounded Global Optimization

A robust multi-objective Bayesian optimization framework considering input uncertainty

Batched Bayesian optimization with correlated candidate uncertainties

Combining Bayesian Active Learning and Conditional Gaussian Process Simulation for Propagating Mixed Uncertainties through Expensive Computer Simulators

Advancing Bayesian Optimization via Learning Correlated Latent Space

Doubly Bayesian Optimization

Robust Bayesian optimization for flexibility analysis of expensive simulation-based models with rigorous uncertainty bounds

Towards Safe Multi-Task Bayesian Optimization