Abstract:We address the computational efficiency in solving the A-optimal Bayesian design of experiments problems for which the observational map is based on partial differential equations and, consequently, is computationally expensive to evaluate. A-optimality is a widely used and easy-to-interpret criterion for Bayesian experimental design. This criterion seeks the optimal experimental design by minimizing the expected conditional variance, which is also known as the expected posterior variance. This study presents a novel likelihood-free approach to the A-optimal experimental design that does not require sampling or integrating the Bayesian posterior distribution. The expected conditional variance is obtained via the variance of the conditional expectation using the law of total variance, and we take advantage of the orthogonal projection property to approximate the conditional expectation. We derive an asymptotic error estimation for the proposed estimator of the expected conditional variance and show that the intractability of the posterior distribution does not affect the performance of our approach. We use an artificial neural network (ANN) to approximate the nonlinear conditional expectation in the implementation of our method. We then extend our approach for dealing with the case that the domain of experimental design parameters is continuous by integrating the training process of the ANN into minimizing the expected conditional variance. Through numerical experiments, we demonstrate that our method greatly reduces the number of observation model evaluations compared with widely used importance sampling-based approaches. This reduction is crucial, considering the high computational cost of the observational models. Code is available at <a class="link-external link-https" href="https://github.com/vinh-tr-hoang/DOEviaPACE" rel="external noopener nofollow">this https URL</a>.

Scalable Bayesian variable selection and model averaging under block orthogonal design

Bayesian block-diagonal variable selection and model averaging

Bayesian Variable Selection in Linear Regression in One Pass for Large Data Sets

Bayesian variable selection in linear regression models with instrumental variables

Scalable Bayesian bi-level variable selection in generalized linear models

Scalable Approximations of Marginal Posteriors in Variable Selection

Scalable Bayesian variable selection for structured high‐dimensional data

Robust Bayesian nonparametric variable selection for linear regression

Research on Bayesian Variable Selection and Model Averaging

Scalable method for Bayesian experimental design without integrating over posterior distribution

Variational Bayesian Inference in High-Dimensional Linear Mixed Models

Bayesian optimal blocking of factorial designs

Stochastic variational inference for large-scale discrete choice models using adaptive batch sizes

Approximate Laplace approximations for scalable model selection

Bayesian variable selection for matrix autoregressive models

Bayesian sparse multiple regression for simultaneous rank reduction and variable selection

A Conceptual Introduction to Bayesian Model Averaging

Bayesian model selection of stochastic block models

Bayesian Variable Selection with Related Predictors

Variable Selection for High-dimensional Generalized Linear Models using an Iterated Conditional Modes/Medians Algorithm

Efficient construction of Bayes optimal designs for stochastic process models