Abstract:Experimental design is a process of obtaining a product with target property via experimentation. Bayesian optimization offers a sample-efficient tool for experimental design when experiments are expensive. Often, expert experimenters have 'hunches' about the behavior of the experimental system, offering potentials to further improve the efficiency. In this paper, we consider per-variable monotonic trend in the underlying property that results in a unimodal trend in those variables for a target value optimization. For example, sweetness of a candy is monotonic to the sugar content. However, to obtain a target sweetness, the utility of the sugar content becomes a unimodal function, which peaks at the value giving the target sweetness and falls off both ways. In this paper, we propose a novel method to solve such problems that achieves two main objectives: a) the monotonicity information is used to the fullest extent possible, whilst ensuring that b) the convergence guarantee remains intact. This is achieved by a two-stage Gaussian process modeling, where the first stage uses the monotonicity trend to model the underlying property, and the second stage uses `virtual' samples, sampled from the first, to model the target value optimization function. The process is made theoretically consistent by adding appropriate adjustment factor in the posterior computation, necessitated because of using the `virtual' samples. The proposed method is evaluated through both simulations and real world experimental design problems of a) new short polymer fiber with the target length, and b) designing of a new three dimensional porous scaffolding with a target porosity. In all scenarios our method demonstrates faster convergence than the basic Bayesian optimization approach not using such `hunches'.

Optimization-Driven Adaptive Experimentation

Adaptive Experimentation at Scale: A Computational Framework for Flexible Batches

Adaptive Experimentation with Delayed Binary Feedback

An Adaptive Optimal Strategy Based on the Combination of the Dynamic-Q Optimization Method and Response Surface Methodology

Accelerating Experimental Design by Incorporating Experimenter Hunches

A Framework of Scalable Dynamic Test Problems for Dynamic Multi-Objective Optimization

Dynamic Optimization in Fast-Changing Environments Via Offline Evolutionary Search

Solving Expensive Optimization Problems in Dynamic Environments with Meta-learning

Adaptive Partitioning Strategy for High-Dimensional Discrete Simulation-based Optimization Problems

AExGym: Benchmarks and Environments for Adaptive Experimentation

Emulating Expert Insight: A Robust Strategy for Optimal Experimental Design

An Adaptive Metaheuristic Framework for Changing Environments

Dynamic constrained multi-objective optimization based on adaptive combinatorial response mechanism

An Adaptive Optimization Technique for Dynamic Environments

An adaptive sampling algorithm for simulation-based optimization with descriptive complexity constraints

Bayesian optimization with adaptive surrogate models for automated experimental design

Optimizing Adaptive Experiments: A Unified Approach to Regret Minimization and Best-Arm Identification

An adaptive balance optimization algorithm and its engineering application

A Hybrid Optimization Framework with Dynamic Transition Scheme for Large-Scale Portfolio Management

PNOD: An Efficient Projected Newton Framework for Exact Optimal Experimental Designs

Finite Horizon Optimization: Framework and Applications