Abstract:We address the computational efficiency in solving the A-optimal Bayesian design of experiments problems for which the observational map is based on partial differential equations and, consequently, is computationally expensive to evaluate. A-optimality is a widely used and easy-to-interpret criterion for Bayesian experimental design. This criterion seeks the optimal experimental design by minimizing the expected conditional variance, which is also known as the expected posterior variance. This study presents a novel likelihood-free approach to the A-optimal experimental design that does not require sampling or integrating the Bayesian posterior distribution. The expected conditional variance is obtained via the variance of the conditional expectation using the law of total variance, and we take advantage of the orthogonal projection property to approximate the conditional expectation. We derive an asymptotic error estimation for the proposed estimator of the expected conditional variance and show that the intractability of the posterior distribution does not affect the performance of our approach. We use an artificial neural network (ANN) to approximate the nonlinear conditional expectation in the implementation of our method. We then extend our approach for dealing with the case that the domain of experimental design parameters is continuous by integrating the training process of the ANN into minimizing the expected conditional variance. Through numerical experiments, we demonstrate that our method greatly reduces the number of observation model evaluations compared with widely used importance sampling-based approaches. This reduction is crucial, considering the high computational cost of the observational models. Code is available at <a class="link-external link-https" href="https://github.com/vinh-tr-hoang/DOEviaPACE" rel="external noopener nofollow">this https URL</a>.

A Likelihood-Free Approach to Goal-Oriented Bayesian Optimal Experimental Design

Goal-Oriented Bayesian Optimal Experimental Design for Nonlinear Models using Markov Chain Monte Carlo

Goal-Oriented Optimal Design of Experiments for Large-Scale Bayesian Linear Inverse Problems

Probabilistic Bayesian optimal experimental design using conditional normalizing flows

Variational Bayesian Optimal Experimental Design with Normalizing Flows

Goal oriented optimal design of infinite-dimensional Bayesian inverse problems using quadratic approximations

Optimal experimental design: Formulations and computations

Learning Arbitrary Quantities of Interest from Expensive Black-Box Functions through Bayesian Sequential Optimal Design

Bayesian Experimental Design via Contrastive Diffusions

Variational Sequential Optimal Experimental Design using Reinforcement Learning

Non-intrusive optimal experimental design for large-scale nonlinear Bayesian inverse problems using a Bayesian approximation error approach

Optimal design for linear models via gradient flow

An Induced Natural Selection Heuristic for Finding Optimal Bayesian Experimental Designs

Bayesian Optimization Based on K-Optimality

A General Recipe for Likelihood-free Bayesian Optimization

Scalable method for Bayesian experimental design without integrating over posterior distribution

Sequential Bayesian optimal experimental design via approximate dynamic programming

A Fast and Scalable Method for A-Optimal Design of Experiments for Infinite-dimensional Bayesian Nonlinear Inverse Problems

Accurate, scalable, and efficient Bayesian optimal experimental design with derivative-informed neural operators

Graph-Based Bayesian Optimization for Large-Scale Objective-Based Experimental Design

Optimal design of large-scale nonlinear Bayesian inverse problems under model uncertainty