Abstract:This paper focuses on the contextual optimization problem where a decision is subject to some uncertain parameters and covariates that have some predictive power on those parameters are available before the decision is made. More specifically, we focus on solving the Wasserstein-distance-based distributionally robust optimization (DRO) model for the problem, which maximizes the worst-case expected objective over an uncertainty set including all distributions closed enough to a nominal distribution with respect to the Wasserstein distance. We develop a stochastic gradient descent algorithm based on the idea of data augmentation to solve the model efficiently. The algorithm iteratively a) does a bootstrapping sample from the nominal distribution; b) perturbs the adversarially and c) updates decisions. Accordingly, the computational time of the algorithm is only determined by the number of iterations and the complexity of computing the gradient of a single sample. Except for efficiently solving the model, the algorithm provide additional advantages that the proposed algorithm can cope with any nominal distributions and therefore is extendable to solve the problem in an online setting. We also prove that the algorithm converges to the optimal solution of the DRO model at a rate of a $O(1/\sqrt{T})$, where $T$ is the number of iterations of bootstrapping. Consequently, the performance guarantee of the algorithm is that of the DRO model plus $O(1/\sqrt{T})$. Through extensive numerical experiments, we demonstrate the superior performance of the proposed algorithm to several benchmarks.

Solving Contextual Stochastic Optimization Problems through Contextual Distribution Estimation

Data-Driven Stochastic Optimization for Power Grids Scheduling under High Wind Penetration

Two-Stage Stochastic Optimization of the Integrated Electricity-Gas System Considering Net Load Uncertainty Based on Contextual Optimization

A Survey of Contextual Optimization Methods for Decision Making under Uncertainty

Achieving Robust Data-driven Contextual Decision Making in a Data Augmentation Way

Stochastic Bayesian Optimization with Unknown Continuous Context Distribution via Kernel Density Estimation

Residuals-Based Contextual Distributionally Robust Optimization with Decision-Dependent Uncertainty

A Distributionally Robust Optimization Approach for Chance-Constrained Stochastic Multi-Attribute Decision-Making with Unknown Probability Density Function

Stochastic Optimization Approaches in Solving Energy Scheduling Problems under Uncertainty

Stochastic Optimization Forests

Uncertainty Quantification for Demand Prediction in Contextual Dynamic Pricing.

Contextual Optimization under Covariate Shift: A Robust Approach by Intersecting Wasserstein Balls

Fast Rates for Contextual Linear Optimization

Stochastic Distributionally Robust Unit Commitment with Deep Scenario Clustering

Forecasting Outside the Box: Application-Driven Optimal Pointwise Forecasts for Stochastic Optimization

Contextual Stochastic Optimization for Omnichannel Multi-Courier Order Fulfillment Under Delivery Time Uncertainty

Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems

Out-of-distribution Robust Optimization

Bayesian Nonparametric Two-Stage Distributionally Robust Unit Commitment Optimization: From Global Multimodality to Local Trimming-Wasserstein Ambiguity

Data-driven Distributionally Robust Joint Chance-Constrained Optimization for Industrial Utility systems under Uncertainty