Abstract:Numerical simulations consist of many components that affect the simulation accuracy and the required computational resources. However, finding an optimal combination of components and their parameters under constraints can be a difficult, time-consuming and often manual process. Classical adaptivity does not fully solve the problem, as it comes with significant implementation cost and is difficult to expand to multi-dimensional parameter spaces. Also, many existing data-based optimization approaches treat the optimization problem as a black-box, thus requiring a large amount of data. We present a constrained, model-based Bayesian optimization approach that avoids black-box models by leveraging existing knowledge about the simulation components and properties of the simulation behavior. The main focus of this paper is on the stochastic modeling ansatz for simulation error and run time as optimization objective and constraint, respectively. To account for data covering multiple orders of magnitude, our approach operates on a logarithmic scale. The models use a priori knowledge of the simulation components such as convergence orders and run time estimates. Together with suitable priors for the model parameters, the model is able to make accurate predictions of the simulation behavior. Reliably modeling the simulation behavior yields a fast optimization procedure because it enables the optimizer to quickly indicate promising parameter values. We test our approach experimentally using the multi-scale muscle simulation framework OpenDiHu and show that we successfully optimize the time step widths in a time splitting approach in terms of minimizing the overall error under run time constraints.

Dependency Structure Search Bayesian Optimization for Decision Making Models

High-dimensional Bayesian optimization using low-dimensional feature spaces

High-Dimensional Bayesian Optimization via Tree-Structured Additive Models

Multi-agent Black-box Optimization using a Bayesian Approach to Alternating Direction Method of Multipliers

Bayesian Optimization of Combinatorial Structures

Cooperative Bayesian Optimization for Imperfect Agents

Relaxing the Additivity Constraints in Decentralized No-Regret High-Dimensional Bayesian Optimization

A Model Recognition Approach for Solving Interactive Dynamic Influence Diagrams

Controlling Model Complexity in Probabilistic Model-Based Dynamic Optimization of Neural Network Structures

Deep Learning for Explicitly Modeling Optimization Landscapes

Efficient Learning of Decision-Making Models: A Penalty Block Coordinate Descent Algorithm for Data-Driven Inverse Optimization

Model-Based Deep Learning: On the Intersection of Deep Learning and Optimization

Belief Rule Base Structure and Parameter Joint Optimization under Disjunctive Assumption for Nonlinear Complex System Modeling

Bayesian Optimization Algorithms for Multi-objective Optimization

Solving Expensive Optimization Problems in Dynamic Environments with Meta-learning

Knowledge-based modeling of simulation behavior for Bayesian optimization

Bayesian Optimization with Binary Auxiliary Information

Optimization inspired Multi-Branch Equilibrium Models

ENTMOOT: A Framework for Optimization over Ensemble Tree Models

Dynamic Subgoal-based Exploration via Bayesian Optimization