Abstract:This work addresses data-driven inverse optimization (IO), where the goal is to estimate unknown parameters in an optimization model from observed decisions that can be assumed to be optimal or near-optimal solutions to the optimization problem. The IO problem is commonly formulated as a large-scale bilevel program that is notoriously difficult to solve. Deviating from traditional exact solution methods, we propose a derivative-free optimization approach based on Bayesian optimization, which we call BO4IO, to solve general IO problems. We treat the IO loss function as a black box and approximate it with a Gaussian process model. Using the predicted posterior function, an acquisition function is minimized at each iteration to query new candidate solutions and sequentially converge to the optimal parameter estimates. The main advantages of using Bayesian optimization for IO are two-fold: (i) it circumvents the need of complex reformulations of the bilevel program or specialized algorithms and can hence enable computational tractability even when the underlying optimization problem is nonconvex or involves discrete variables, and (ii) it allows approximations of the profile likelihood, which provide uncertainty quantification on the IO parameter estimates. We apply the proposed method to three computational case studies, covering different classes of forward optimization problems ranging from convex nonlinear to nonconvex mixed-integer nonlinear programs. Our extensive computational results demonstrate the efficacy and robustness of BO4IO to accurately estimate unknown model parameters from small and noisy datasets. In addition, the proposed profile likelihood analysis has proven to be effective in providing good approximations of the confidence intervals on the parameter estimates and assessing the identifiability of the unknown parameters.

Quantile Inverse Optimization: Improving Stability in Inverse Linear Programming

A Direct Coupled Solution Methodology for Efficient Robust Optimizations of Inverse Problems under Uncertainty

BO4IO: A Bayesian optimization approach to inverse optimization with uncertainty quantification

A Population-Based Incremental Learning Method for Robust Optimal Solutions

Constrained Optimization in the Presence of Noise

Sparse Estimation Via ℓ_q Optimization Method in High-Dimensional Linear Regression

A fast robust optimization methodology based on polynomial chaos and evolutionary algorithm for inverse problems

On quantitative stability in infinite-dimensional optimization under uncertainty

Inferring Linear Feasible Regions using Inverse Optimization

Inverse Optimization: Theory and Applications

Efficient Use of Quantum Linear System Algorithms in Inexact Infeasible IPMs for Linear Optimization

An Analysis of a Multi-Level Projected Steepest Descent Iteration for Nonlinear Inverse Problems in Banach Spaces Subject to Stability Constraints

Stability and Continuity in Robust Linear and Linear Semi-Infinite Optimization

Inverse optimization for multi-objective linear programming

Variable-Sized Uncertainty and Inverse Problems in Robust Optimization

Nonconvex quasi-variational inequalities: stability analysis and application to numerical optimization

An Empirical Quantile Estimation Approach to Nonlinear Optimization Problems with Chance Constraints

Inverse optimization in semi-definite programs to impute unknown constraint matrices

Statistically consistent inverse optimal control for discrete-time indefinite linear-quadratic systems

An Empirical Quantile Estimation Approach for Chance-Constrained Nonlinear Optimization Problems

Improving the Global Convergence of Inexact Restoration Methods for Constrained Optimization Problems