Abstract:Experimental design is a process of obtaining a product with target property via experimentation. Bayesian optimization offers a sample-efficient tool for experimental design when experiments are expensive. Often, expert experimenters have 'hunches' about the behavior of the experimental system, offering potentials to further improve the efficiency. In this paper, we consider per-variable monotonic trend in the underlying property that results in a unimodal trend in those variables for a target value optimization. For example, sweetness of a candy is monotonic to the sugar content. However, to obtain a target sweetness, the utility of the sugar content becomes a unimodal function, which peaks at the value giving the target sweetness and falls off both ways. In this paper, we propose a novel method to solve such problems that achieves two main objectives: a) the monotonicity information is used to the fullest extent possible, whilst ensuring that b) the convergence guarantee remains intact. This is achieved by a two-stage Gaussian process modeling, where the first stage uses the monotonicity trend to model the underlying property, and the second stage uses `virtual' samples, sampled from the first, to model the target value optimization function. The process is made theoretically consistent by adding appropriate adjustment factor in the posterior computation, necessitated because of using the `virtual' samples. The proposed method is evaluated through both simulations and real world experimental design problems of a) new short polymer fiber with the target length, and b) designing of a new three dimensional porous scaffolding with a target porosity. In all scenarios our method demonstrates faster convergence than the basic Bayesian optimization approach not using such `hunches'.

Heuristic construction of exact experimental designs under multiple resource constraints

Approximate D-optimal Experimental Design with Simultaneous Size and Cost Constraints

Computing optimal experimental designs with respect to a compound Bayes risk criterion

The polytope of optimal approximate designs: extending the selection of informative experiments

CVXSADes: a stochastic algorithm for constructing optimal exact regression designs with single or multiple objectives

An Induced Natural Selection Heuristic for Finding Optimal Bayesian Experimental Designs

Design-based Estimation Theory for Complex Experiments

Constrained Minimum Energy Designs

Efficient construction of Bayes optimal designs for stochastic process models

Optimal exact designs of experiments via Mixed Integer Nonlinear Programming

Optimal Design of Multifactor Experiments via Grid Exploration

PNOD: An Efficient Projected Newton Framework for Exact Optimal Experimental Designs

Efficient Simulation Resource Sharing and Allocation for Selecting the Best.

An Adaptive Algorithm based on High-Dimensional Function Approximation to obtain Optimal Designs

Accelerating Experimental Design by Incorporating Experimenter Hunches

Constructing Bayesian Optimal Designs for Discrete Choice Experiments by Simulated Annealing

A Randomized Exchange Algorithm for Optimal Design of Multi-Response Experiments

Computing Optimal Designs of multiresponse Experiments reduces to Second-Order Cone Programming

Multiplication Algorithms for Approximate Optimal Distributions with Cost Constraints

Robust multi-stage model-based design of optimal experiments for nonlinear estimation

Optimization-Driven Adaptive Experimentation