Abstract:Estimating arbitrary quantities of interest (QoIs) that are non-linear operators of complex, expensive-to-evaluate, black-box functions is a challenging problem due to missing domain knowledge and finite budgets. Bayesian optimal design of experiments (BODE) is a family of methods that identify an optimal design of experiments (DOE) under different contexts, using only in a limited number of function evaluations. Under BODE methods, sequential design of experiments (SDOE) accomplishes this task by selecting an optimal sequence of experiments while using data-driven probabilistic surrogate models instead of the expensive black-box function. Probabilistic predictions from the surrogate model are used to define an information acquisition function (IAF) which quantifies the marginal value contributed or the expected information gained by a hypothetical experiment. The next experiment is selected by maximizing the IAF. A generally applicable IAF is the expected information gain (EIG) about a QoI as captured by the expectation of the Kullback-Leibler divergence between the predictive distribution of the QoI after doing a hypothetical experiment and the current predictive distribution about the same QoI. We model the underlying information source as a fully-Bayesian, non-stationary Gaussian process (FBNSGP), and derive an approximation of the information gain of a hypothetical experiment about an arbitrary QoI conditional on the hyper-parameters The EIG about the same QoI is estimated by sample averages to integrate over the posterior of the hyper-parameters and the potential experimental outcomes. We demonstrate the performance of our method in four numerical examples and a practical engineering problem of steel wire manufacturing. The method is compared to two classic SDOE methods: random sampling and uncertainty sampling.

Bayesian Optimal Design of Experiments For Inferring The Statistical Expectation Of A Black-Box Function

Bayesian Optimal Design of Experiments for Inferring the Statistical Expectation of Expensive Black-Box Functions

Learning Arbitrary Quantities of Interest from Expensive Black-Box Functions through Bayesian Sequential Optimal Design

A Sequential Sampling-Based Bayesian Numerical Method for Reliability-Based Design Optimization

Extending Expected Improvement for High-dimensional Stochastic Optimization of Expensive Black-Box Functions

Process Quality Control Through Bayesian Optimization with Adaptive Local Convergence

Boundary Exploration for Bayesian Optimization With Unknown Physical Constraints

Bayesian Optimization Based on K-Optimality

Robust optimal design of large-scale Bayesian nonlinear inverse problems

Optimal design of large-scale nonlinear Bayesian inverse problems under model uncertainty

Probabilistic Bayesian optimal experimental design using conditional normalizing flows

Bayesian optimization as a flexible and efficient design framework for sustainable process systems

Goal-Oriented Optimal Design of Experiments for Large-Scale Bayesian Linear Inverse Problems

BOIS: Bayesian Optimization of Interconnected Systems

Bayesian Optimisation for Sequential Experimental Design with Applications in Additive Manufacturing

Metrics for Bayesian Optimal Experiment Design under Model Misspecification

Bayesian Experimental Design via Contrastive Diffusions

Enhanced Bayesian Optimization via Preferential Modeling of Abstract Properties

Goal oriented optimal design of infinite-dimensional Bayesian inverse problems using quadratic approximations

An Integrated Method of Bayesian Optimization and D-Optimal Design for Chemical Experiment Optimization

Laplace-based strategies for Bayesian optimal experimental design with nuisance uncertainty