Abstract:Randomized decision making refers to the process of making decisions randomly according to the outcome of an independent randomization device, such as a dice roll or a coin flip. The concept is unconventional, and somehow counterintuitive, in the domain of mathematical programming, in which deterministic decisions are usually sought even when the problem parameters are uncertain. However, it has recently been shown that using a randomized, rather than a deterministic, strategy in nonconvex distributionally robust optimization (DRO) problems can lead to improvements in their objective values. It is still unknown, though, what is the magnitude of improvement that can be attained through randomization or how to numerically find the optimal randomized strategy. In this paper, we study the value of randomization in mixed-integer DRO problems and show that it is bounded by the improvement achievable through its continuous relaxation. Furthermore, we identify conditions under which the bound is tight. We then develop algorithmic procedures, based on column generation, for solving both single- and two-stage linear DRO problems with randomization that can be used with both moment-based and Wasserstein ambiguity sets. Finally, we apply the proposed algorithm to solve three classical discrete DRO problems: the assignment problem, the uncapacitated facility location problem, and the capacitated facility location problem and report numerical results that show the quality of our bounds, the computational efficiency of the proposed solution method, and the magnitude of performance improvement achieved by randomized decisions. Summary of Contribution: In this paper, we present both theoretical results and algorithmic tools to identify optimal randomized strategies for discrete distributionally robust optimization (DRO) problems and evaluate the performance improvements that can be achieved when using them rather than classical deterministic strategies. On the theory side, we provide improvement bounds based on continuous relaxation and identify the conditions under which these bound are tight. On the algorithmic side, we propose a finitely convergent, two-layer, column-generation algorithm that iterates between identifying feasible solutions and finding extreme realizations of the uncertain parameter. The proposed algorithm was implemented to solve distributionally robust stochastic versions of three classical optimization problems and extensive numerical results are reported. The paper extends a previous, purely theoretical work of the first author on the idea of randomized strategies in nonconvex DRO problems by providing useful bounds and algorithms to solve this kind of problems.

Stochastic First-Order Algorithms for Constrained Distributionally Robust Optimization

Multistage Distributionally Robust Optimization for Integrated Production and Maintenance Scheduling

Distributed Robust Optimization in Networked System.

Large-Scale Non-convex Stochastic Constrained Distributionally Robust Optimization

Efficient Algorithms for Distributionally Robust Stochastic Optimization with Discrete Scenario Support

Numerical method for approximately optimal solutions of two-stage distributionally robust optimization with marginal constraints

Distributed Distributionally Robust Optimization with Non-Convex Objectives

Federated Distributionally Robust Optimization with Non-Convex Objectives: Algorithm and Analysis

A Primal-Dual Algorithm for Faster Distributionally Robust Optimization

Distributionally Robust Optimization with Decision-Dependent Information Discovery

Computationally Efficient Approximations for Distributionally Robust Optimization Under Moment and Wasserstein Ambiguity

First-Order Algorithms for Robust Optimization Problems via Convex-Concave Saddle-Point Lagrangian Reformulation

Bounds for Multistage Mixed-Integer Distributionally Robust Optimization

Data-driven Distributionally Robust Optimization over Time

Distributionally Robust Optimization under Distorted Expectations

The Value of Randomized Solutions in Mixed-Integer Distributionally Robust Optimization Problems

Consensus Distributionally Robust Optimization With Phi-Divergence

Stochastic Approximation Approaches to Group Distributionally Robust Optimization and Beyond

Distributionally Robust Optimization with Bias and Variance Reduction

Distributionally Robust Optimization with Markovian Data

Wasserstein Distributionally Robust Optimization with Heterogeneous Data Sources