Abstract:This work addresses data-driven inverse optimization (IO), where the goal is to estimate unknown parameters in an optimization model from observed decisions that can be assumed to be optimal or near-optimal solutions to the optimization problem. The IO problem is commonly formulated as a large-scale bilevel program that is notoriously difficult to solve. Deviating from traditional exact solution methods, we propose a derivative-free optimization approach based on Bayesian optimization, which we call BO4IO, to solve general IO problems. We treat the IO loss function as a black box and approximate it with a Gaussian process model. Using the predicted posterior function, an acquisition function is minimized at each iteration to query new candidate solutions and sequentially converge to the optimal parameter estimates. The main advantages of using Bayesian optimization for IO are two-fold: (i) it circumvents the need of complex reformulations of the bilevel program or specialized algorithms and can hence enable computational tractability even when the underlying optimization problem is nonconvex or involves discrete variables, and (ii) it allows approximations of the profile likelihood, which provide uncertainty quantification on the IO parameter estimates. We apply the proposed method to three computational case studies, covering different classes of forward optimization problems ranging from convex nonlinear to nonconvex mixed-integer nonlinear programs. Our extensive computational results demonstrate the efficacy and robustness of BO4IO to accurately estimate unknown model parameters from small and noisy datasets. In addition, the proposed profile likelihood analysis has proven to be effective in providing good approximations of the confidence intervals on the parameter estimates and assessing the identifiability of the unknown parameters.

Two-step Lookahead Bayesian Optimization with Inequality Constraints

Multi-Step Budgeted Bayesian Optimization with Unknown Evaluation Costs

Non-Myopic Multi-Objective Bayesian Optimization

Bayesian Optimization for Non-Convex Two-Stage Stochastic Optimization Problems

Differentiating Policies for Non-Myopic Bayesian Optimization

NM2-BO: Non-Myopic Multifidelity Bayesian Optimization

Constrained Bayesian Optimization with Adaptive Active Learning of Unknown Constraints

On a New Improvement-Based Acquisition Function for Bayesian Optimization

Accelerating Look-ahead in Bayesian Optimization: Multilevel Monte Carlo is All you Need

A Bi-Objective Optimization Based Acquisition Strategy for Batch Bayesian Global Optimization

BO4IO: A Bayesian optimization approach to inverse optimization with uncertainty quantification

Approximation-Aware Bayesian Optimization

Pareto-efficient Acquisition Functions for Cost-Aware Bayesian Optimization

A Bayesian Optimization Framework for Finding Local Optima in Expensive Multi-Modal Functions

Voronoi Candidates for Bayesian Optimization

Principled Preferential Bayesian Optimization

Bayesian Optimization with Formal Safety Guarantees via Online Conformal Prediction

High-dimensional Bayesian optimization using low-dimensional feature spaces

AVEI-BO: an efficient Bayesian optimization using adaptively varied expected improvement

Practical Batch Bayesian Optimization for Less Expensive Functions

Constrained Bayesian Optimization Under Partial Observations: Balanced Improvements and Provable Convergence