Abstract:Randomized decision making refers to the process of making decisions randomly according to the outcome of an independent randomization device, such as a dice roll or a coin flip. The concept is unconventional, and somehow counterintuitive, in the domain of mathematical programming, in which deterministic decisions are usually sought even when the problem parameters are uncertain. However, it has recently been shown that using a randomized, rather than a deterministic, strategy in nonconvex distributionally robust optimization (DRO) problems can lead to improvements in their objective values. It is still unknown, though, what is the magnitude of improvement that can be attained through randomization or how to numerically find the optimal randomized strategy. In this paper, we study the value of randomization in mixed-integer DRO problems and show that it is bounded by the improvement achievable through its continuous relaxation. Furthermore, we identify conditions under which the bound is tight. We then develop algorithmic procedures, based on column generation, for solving both single- and two-stage linear DRO problems with randomization that can be used with both moment-based and Wasserstein ambiguity sets. Finally, we apply the proposed algorithm to solve three classical discrete DRO problems: the assignment problem, the uncapacitated facility location problem, and the capacitated facility location problem and report numerical results that show the quality of our bounds, the computational efficiency of the proposed solution method, and the magnitude of performance improvement achieved by randomized decisions. Summary of Contribution: In this paper, we present both theoretical results and algorithmic tools to identify optimal randomized strategies for discrete distributionally robust optimization (DRO) problems and evaluate the performance improvements that can be achieved when using them rather than classical deterministic strategies. On the theory side, we provide improvement bounds based on continuous relaxation and identify the conditions under which these bound are tight. On the algorithmic side, we propose a finitely convergent, two-layer, column-generation algorithm that iterates between identifying feasible solutions and finding extreme realizations of the uncertain parameter. The proposed algorithm was implemented to solve distributionally robust stochastic versions of three classical optimization problems and extensive numerical results are reported. The paper extends a previous, purely theoretical work of the first author on the idea of randomized strategies in nonconvex DRO problems by providing useful bounds and algorithms to solve this kind of problems.

Derivative-Free Optimization Via Classification.

Accelerated Optimization in Deep Learning with a Proportional-Integral-derivative Controller

Sequential Classification-Based Optimization for Direct Policy Search.

Asynchronous classification-based optimization

An Aggressive Reduction on the Complexity of Optimization for Non-Strongly Convex Objectives

Derivative-Free Optimization of High-Dimensional Non-Convex Functions by Sequential Random Embeddings

On Sampling-And-Classification Optimization In Discrete Domains

$Q$-fully Quadratic Modeling and its Application in a Random Subspace Derivative-free Method

A Hybrid Method of Combinatorial Search and Coordinate Descent for Discrete Optimization

Q-fully quadratic modeling and its application in a random subspace derivative-free method

A discrete-time neural network for optimization problems with hybrid constraints.

Tackling Prevalent Conditions in Unsupervised Combinatorial Optimization: Cardinality, Minimum, Covering, and More

Derivative-Free Optimization via Adaptive Sampling Strategies

Interpretable classifier design by axiomatic fuzzy sets theory and derivative-free optimization

Scalable Subspace Methods for Derivative-Free Nonlinear Least-Squares Optimization

Curvature-Aware Derivative-Free Optimization

Recursive Decomposition for Nonconvex Optimization

A modularized algorithmic framework for interface related optimization problems using characteristic functions

Efficiency of Coordinate Descent Methods For Structured Nonconvex Optimization

The Value of Randomized Solutions in Mixed-Integer Distributionally Robust Optimization Problems

ODE-based Learning to Optimize