Abstract:Randomized decision making refers to the process of making decisions randomly according to the outcome of an independent randomization device, such as a dice roll or a coin flip. The concept is unconventional, and somehow counterintuitive, in the domain of mathematical programming, in which deterministic decisions are usually sought even when the problem parameters are uncertain. However, it has recently been shown that using a randomized, rather than a deterministic, strategy in nonconvex distributionally robust optimization (DRO) problems can lead to improvements in their objective values. It is still unknown, though, what is the magnitude of improvement that can be attained through randomization or how to numerically find the optimal randomized strategy. In this paper, we study the value of randomization in mixed-integer DRO problems and show that it is bounded by the improvement achievable through its continuous relaxation. Furthermore, we identify conditions under which the bound is tight. We then develop algorithmic procedures, based on column generation, for solving both single- and two-stage linear DRO problems with randomization that can be used with both moment-based and Wasserstein ambiguity sets. Finally, we apply the proposed algorithm to solve three classical discrete DRO problems: the assignment problem, the uncapacitated facility location problem, and the capacitated facility location problem and report numerical results that show the quality of our bounds, the computational efficiency of the proposed solution method, and the magnitude of performance improvement achieved by randomized decisions. Summary of Contribution: In this paper, we present both theoretical results and algorithmic tools to identify optimal randomized strategies for discrete distributionally robust optimization (DRO) problems and evaluate the performance improvements that can be achieved when using them rather than classical deterministic strategies. On the theory side, we provide improvement bounds based on continuous relaxation and identify the conditions under which these bound are tight. On the algorithmic side, we propose a finitely convergent, two-layer, column-generation algorithm that iterates between identifying feasible solutions and finding extreme realizations of the uncertain parameter. The proposed algorithm was implemented to solve distributionally robust stochastic versions of three classical optimization problems and extensive numerical results are reported. The paper extends a previous, purely theoretical work of the first author on the idea of randomized strategies in nonconvex DRO problems by providing useful bounds and algorithms to solve this kind of problems.

Zero-One Laws for Random Feasibility Problems

A Bound on the Expected Optimality of Random Feasible Solutions to Combinatorial Optimization Problems

A concentration inequality for random combinatorial optimisation problems

Hardness of Random Optimization Problems for Boolean Circuits, Low-Degree Polynomials, and Langevin Dynamics

Margin theory for the scenario-based approach to robust optimization in high dimension

Integer Feasibility of Random Polytopes

On the optimal objective value of random linear programs

Algorithm-independent bounds on complex optimization through the statistics of marginal optima

Relative Regularity Conditions and Linear Regularity Properties for Split Feasibility Problems in Normed Linear Spaces

Inequalities Concerning Maximum Modulus and Zeros of Random Entire Functions

Global Convergence of Inexact Augmented Lagrangian Method for Zero-One Composite Optimization

Characterisation of zero duality gap for optimization problems in spaces without linear structure

Exact objectives of random linear programs and mean widths of random polyhedrons

Zero-one Laws for a Control Problem with Random Action Sets

Concentration and limit of large random matrices with given margins

Equivalent Lipschitz Surrogates for Zero-Norm and Rank Optimization Problems

Quantum Algorithms and Lower Bounds for Finite-Sum Optimization

Average-case matrix discrepancy: satisfiability bounds

Random zero sets with local growth guarantees

The Value of Randomized Solutions in Mixed-Integer Distributionally Robust Optimization Problems

An exact solution method for unconstrained quadratic 0–1 programming: a geometric approach